You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/16 14:39:14 UTC

[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_60-ea-b04) - Build # 9387 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9387/
Java: 64bit/jdk1.7.0_60-ea-b04 -XX:-UseCompressedOops -XX:+UseG1GC

4 tests failed.
FAILED:  org.apache.solr.TestDistributedGrouping.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /g_/s/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /g_/s/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([A60596B27F4B6CF9:27E318AA08140CC5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedGrouping.doTest(TestDistributedGrouping.java:156)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /is/o/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /is/o/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([A60596B27F4B6CF9:27E318AA08140CC5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:177)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:40586/h_a/collection1, http://127.0.0.1:37471/h_a/collection1, http://127.0.0.1:58050/h_a/collection1, http://127.0.0.1:33363/h_a/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:40586/h_a/collection1, http://127.0.0.1:37471/h_a/collection1, http://127.0.0.1:58050/h_a/collection1, http://127.0.0.1:33363/h_a/collection1]
	at __randomizedtesting.SeedInfo.seed([A60596B27F4B6CF9:27E318AA08140CC5]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkQueries(AbstractFullDistribZkTestBase.java:797)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:101)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /h_a/collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 50 more


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:60063/collection1, http://127.0.0.1:48597/collection1, http://127.0.0.1:38835/collection1, http://127.0.0.1:54734/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:60063/collection1, http://127.0.0.1:48597/collection1, http://127.0.0.1:38835/collection1, http://127.0.0.1:54734/collection1]
	at __randomizedtesting.SeedInfo.seed([A60596B27F4B6CF9:27E318AA08140CC5]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.cloud.BasicDistributedZkTest.queryServer(BasicDistributedZkTest.java:1171)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:264)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 49 more




Build Log:
[...truncated 10174 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedGrouping
   [junit4]   2> 194005 T661 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 194006 T661 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /g_/s
   [junit4]   2> 194009 T661 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 194010 T661 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 194013 T661 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 194015 T661 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:40488
   [junit4]   2> 194016 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 194017 T661 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 194017 T661 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 194017 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 194033 T661 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/solr.xml
   [junit4]   2> 194092 T661 oasc.CoreContainer.<init> New CoreContainer 53435398
   [junit4]   2> 194092 T661 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 194093 T661 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 194093 T661 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 194094 T661 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 194094 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 194094 T661 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 194094 T661 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 194094 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 194095 T661 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 194095 T661 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 194100 T661 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 194101 T661 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 194101 T661 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 194105 T671 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 194105 T671 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 194106 T671 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 194106 T671 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 194159 T671 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 194219 T671 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 194220 T671 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 194231 T671 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 194621 T671 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 194622 T671 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 194623 T671 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 194638 T671 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 194642 T671 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 194661 T671 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 194665 T671 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 194669 T671 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 194670 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 194670 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 194670 T671 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 194671 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 194671 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 194671 T671 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 194671 T671 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedGrouping-1392556597741/control/data/
   [junit4]   2> 194672 T671 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c79caea
   [junit4]   2> 194673 T671 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392556597741/control/data
   [junit4]   2> 194673 T671 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedGrouping-1392556597741/control/data/index/
   [junit4]   2> 194673 T671 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedGrouping-1392556597741/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 194673 T671 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392556597741/control/data/index
   [junit4]   2> 194674 T671 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=67.93359375, floorSegmentMB=0.33984375, forceMergeDeletesPctAllowed=13.79829458589448, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 194675 T671 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4ca7a0d5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c552858)),segFN=segments_1,generation=1}
   [junit4]   2> 194675 T671 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 194676 T671 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 194681 T671 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 194681 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 194681 T671 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 194682 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 194682 T671 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 194682 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 194682 T671 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 194682 T671 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 194683 T671 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 194683 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 194683 T671 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 194684 T671 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 194684 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 194684 T671 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 194684 T671 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 194685 T671 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 194685 T671 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 194686 T671 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 194686 T671 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 194687 T671 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 194687 T671 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 194688 T671 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 194689 T671 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 194689 T671 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 194689 T671 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 194690 T671 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 194690 T671 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194691 T671 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194691 T671 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194692 T671 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194692 T671 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194693 T671 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194693 T671 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194694 T671 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 194695 T671 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 194696 T671 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 194700 T671 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 194702 T671 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 194705 T671 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 194705 T671 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 194706 T671 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=12.9580078125, floorSegmentMB=0.958984375, forceMergeDeletesPctAllowed=26.79359594505192, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 194706 T671 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4ca7a0d5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c552858)),segFN=segments_1,generation=1}
   [junit4]   2> 194707 T671 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 194707 T671 oass.SolrIndexSearcher.<init> Opening Searcher@4d331f91[collection1] main
   [junit4]   2> 194707 T671 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 194768 T671 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 194792 T672 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d331f91[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 194797 T671 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 194797 T661 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 194797 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 194801 T661 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 194803 T661 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 194805 T661 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38268
   [junit4]   2> 194807 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 194808 T661 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 194808 T661 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 194808 T661 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 194830 T661 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/solr.xml
   [junit4]   2> 194870 T661 oasc.CoreContainer.<init> New CoreContainer 2138797220
   [junit4]   2> 194870 T661 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 194871 T661 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 194872 T661 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 194872 T661 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 194872 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 194873 T661 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 194873 T661 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 194873 T661 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 194873 T661 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 194874 T661 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 194879 T661 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 194880 T661 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 194880 T661 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 194885 T683 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 194885 T683 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 194886 T683 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 194886 T683 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 194939 T683 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 195032 T683 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 195033 T683 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 195044 T683 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 195440 T683 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 195441 T683 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 195441 T683 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 195450 T683 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 195453 T683 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 195464 T683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 195467 T683 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 195471 T683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 195471 T683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 195472 T683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 195472 T683 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 195472 T683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 195473 T683 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 195473 T683 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 195473 T683 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedGrouping-1392556597741/shard0/data/
   [junit4]   2> 195473 T683 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1c79caea
   [junit4]   2> 195474 T683 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392556597741/shard0/data
   [junit4]   2> 195475 T683 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedGrouping-1392556597741/shard0/data/index/
   [junit4]   2> 195475 T683 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedGrouping-1392556597741/shard0/data/index' doesn't exist. Creating new index...
   [junit4]   2> 195475 T683 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392556597741/shard0/data/index
   [junit4]   2> 195476 T683 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=67.93359375, floorSegmentMB=0.33984375, forceMergeDeletesPctAllowed=13.79829458589448, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 195476 T683 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@e3d7207 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@875e088)),segFN=segments_1,generation=1}
   [junit4]   2> 195477 T683 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 195477 T683 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 195483 T683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 195483 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 195483 T683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 195484 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 195484 T683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 195484 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 195484 T683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 195485 T683 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 195485 T683 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 195485 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 195485 T683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 195486 T683 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 195486 T683 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 195486 T683 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 195487 T683 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 195487 T683 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 195488 T683 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 195488 T683 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 195489 T683 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 195490 T683 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 195490 T683 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 195491 T683 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 195491 T683 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 195492 T683 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 195492 T683 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 195493 T683 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 195493 T683 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195494 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195495 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195495 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195496 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195496 T683 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195497 T683 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195498 T683 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 195498 T683 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 195499 T683 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 195502 T683 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 195504 T683 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 195507 T683 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 195507 T683 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 195509 T683 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=12.9580078125, floorSegmentMB=0.958984375, forceMergeDeletesPctAllowed=26.79359594505192, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 195509 T683 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@e3d7207 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@875e088)),segFN=segments_1,generation=1}
   [junit4]   2> 195510 T683 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 195510 T683 oass.SolrIndexSearcher.<init> Opening Searcher@5605907b[collection1] main
   [junit4]   2> 195510 T683 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 195515 T683 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 195552 T684 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5605907b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 195562 T683 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 195564 T661 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 195565 T661 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C501 name=collection1 org.apache.solr.core.SolrCore@2f20c565
   [junit4]   2> 195641 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {deleteByQuery=*:* (-1460201428742045696)} 0 3
   [junit4]   2> ASYNC  NEW_CORE C502 name=collection1 org.apache.solr.core.SolrCore@4466d485
   [junit4]   2> 195704 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {deleteByQuery=*:* (-1460201428808105984)} 0 2
   [junit4]   2> 195709 T669 C501 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 195710 T669 C501 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 195710 T669 C501 oass.SolrIndexSearcher.<init> Opening Searcher@2d8e3fe9[collection1] main
   [junit4]   2> 195711 T669 C501 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 195717 T672 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d8e3fe9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 195718 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={commit=true&version=2&waitSearcher=true&wt=javabin&softCommit=false} {commit=} 0 9
   [junit4]   2> 195723 T678 C502 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 195723 T678 C502 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 195724 T678 C502 oass.SolrIndexSearcher.<init> Opening Searcher@57a17c49[collection1] main
   [junit4]   2> 195724 T678 C502 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 195727 T684 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57a17c49[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 195727 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={commit=true&version=2&waitSearcher=true&wt=javabin&softCommit=false} {commit=} 0 4
   [junit4]   2> 195758 T669 C501 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&group.limit=10&q=*:*&group.field=a_si&version=2&group=true&wt=javabin&distrib=false&fl=id,a_si&sort=a_si+asc,+id+asc} hits=0 status=0 QTime=21 
   [junit4]   2> 195860 T682 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::083]:33332/g_/s&group.distributed.first=true&group.limit=10&version=2&group=true&distrib=false&fl=id&NOW=1392556599500&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&wt=javabin&start=0} status=0 QTime=13 
   [junit4]   2> 195878 T678 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&group.limit=10&q=*:*&group.field=a_si&version=2&shards=[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::083]:33332/g_/s&group=true&wt=javabin&fl=id,a_si&sort=a_si+asc,+id+asc} status=0 QTime=110 
   [junit4]   2> 195917 T669 C501 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&group.limit=10&q=*:*&hl.fl=a_t&group.field=a_si&version=2&hl=true&group=true&wt=javabin&distrib=false&fl=id,a_si&sort=a_si+asc,+id+asc} hits=0 status=0 QTime=32 
   [junit4]   2> 195932 T679 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=[ff01::114]:33332/g_/s|[ff01::083]:33332/g_/s|[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s&group.distributed.first=true&group.limit=10&version=2&hl=false&group=true&distrib=false&fl=id&NOW=1392556599656&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&hl.fl=a_t&group.field=a_si&wt=javabin&start=0} status=0 QTime=0 
   [junit4]   2> 195933 T681 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&group.limit=10&q=*:*&hl.fl=a_t&group.field=a_si&version=2&shards=[ff01::114]:33332/g_/s|[ff01::083]:33332/g_/s|[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s&hl=true&group=true&wt=javabin&fl=id,a_si&sort=a_si+asc,+id+asc} status=0 QTime=9 
   [junit4]   2> 195956 T668 C501 oasr.UnInvertedField.<init> UnInverted multi-valued field {field=a_t,memSize=4288,tindexSize=0,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
   [junit4]   2> 195958 T668 C501 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&group.limit=10&q=*:*&facet.field=a_t&group.field=a_si&version=2&facet=true&group=true&wt=javabin&distrib=false&fl=id,a_si&sort=a_si+asc,+id+asc} hits=0 status=0 QTime=18 
   [junit4]   2> 195970 T678 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=[ff01::083]:33332/g_/s|[ff01::114]:33332/g_/s|[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s&group.distributed.first=true&group.limit=10&facet.field=a_t&version=2&group=true&distrib=false&fl=id&NOW=1392556599697&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&facet=false&wt=javabin&start=0} status=0 QTime=0 
   [junit4]   2> 195987 T682 C502 oasr.UnInvertedField.<init> UnInverted multi-valued field {field=a_t,memSize=4288,tindexSize=0,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
   [junit4]   2> 195988 T682 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=[ff01::083]:33332/g_/s|[ff01::114]:33332/g_/s|[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s&group.limit=10&f.a_t.facet.limit=160&facet.field=a_t&version=2&group=true&group.distributed.second=true&distrib=false&fl=id&NOW=1392556599697&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&facet=true&wt=javabin&start=0} status=0 QTime=8 
   [junit4]   2> 196000 T679 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&group.limit=10&q=*:*&facet.field=a_t&group.field=a_si&version=2&shards=[ff01::083]:33332/g_/s|[ff01::114]:33332/g_/s|[ff01::213]:33332/g_/s|https://127.0.0.1:38268/g_/s&facet=true&group=true&wt=javabin&fl=id,a_si&sort=a_si+asc,+id+asc} status=0 QTime=35 
   [junit4]   2> 196013 T667 C501 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&stats=true&group.limit=10&q=*:*&group.field=a_si&version=2&stats.field=a_si&group=true&wt=javabin&distrib=false&fl=id,a_si&sort=a_si+asc,+id+asc} hits=0 status=0 QTime=8 
   [junit4]   2> 196027 T682 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=[ff01::114]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::213]:33332/g_/s|[ff01::083]:33332/g_/s&group.distributed.first=true&stats=false&group.limit=10&version=2&stats.field=a_si&group=true&distrib=false&fl=id&NOW=1392556599750&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&wt=javabin&start=0} status=0 QTime=1 
   [junit4]   2> 196036 T679 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=[ff01::114]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::213]:33332/g_/s|[ff01::083]:33332/g_/s&stats=true&group.limit=10&version=2&stats.field=a_si&group=true&group.distributed.second=true&distrib=false&fl=id&NOW=1392556599750&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&wt=javabin&start=0} status=0 QTime=0 
   [junit4]   2> 196038 T681 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={rows=100&stats=true&group.limit=10&q=*:*&group.field=a_si&version=2&shards=[ff01::114]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::213]:33332/g_/s|[ff01::083]:33332/g_/s&stats.field=a_si&group=true&wt=javabin&fl=id,a_si&sort=a_si+asc,+id+asc} status=0 QTime=20 
   [junit4]   2> 196061 T668 C501 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={group.limit=10&spellcheck=true&version=2&group=true&distrib=false&fl=id,a_si&sort=a_si+asc,+id+asc&rows=100&q=kings&group.field=a_si&qt=spellCheckCompRH&spellcheck.build=true&wt=javabin} hits=0 status=0 QTime=19 
   [junit4]   2> 196093 T678 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={shard.url=https://127.0.0.1:38268/g_/s&group.distributed.first=true&group.limit=10&spellcheck=true&version=2&group=true&distrib=false&fl=id&NOW=1392556599798&sort=a_si+asc,+id+asc&spellcheck.count=5&rows=100&isShard=true&q=kings&group.field=a_si&spellcheck.onlyMorePopular=false&wt=javabin&spellcheck.build=true&start=0&spellcheck.extendedResults=false} status=0 QTime=1 
   [junit4]   2> 196097 T679 C502 oashc.SpellCheckComponent.finishStage https://127.0.0.1:38268/g_/s null
   [junit4]   2> 196098 T679 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={group.limit=10&spellcheck=true&version=2&group=true&fl=id,a_si&sort=a_si+asc,+id+asc&rows=100&q=kings&group.field=a_si&qt=spellCheckCompRH&shards=https://127.0.0.1:38268/g_/s&spellcheck.build=true&wt=javabin} status=0 QTime=32 
   [junit4]   2> 196110 T667 C501 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={fq=a_s:a&group.limit=10&facet.field=a_t&version=2&group=true&distrib=false&fl=id,a_si&sort=a_si+asc,+id+asc&rows=100&q=*:*&group.field=a_si&facet=true&wt=javabin&group.truncate=true} hits=0 status=0 QTime=8 
   [junit4]   2> 196119 T679 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={fq=a_s:a&shard.url=[ff01::083]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::114]:33332/g_/s|[ff01::213]:33332/g_/s&group.distributed.first=true&group.limit=10&facet.field=a_t&version=2&group=true&distrib=false&fl=id&NOW=1392556599846&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&facet=false&wt=javabin&start=0&group.truncate=true} status=0 QTime=1 
   [junit4]   2> 196135 T679 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={fq=a_s:a&shard.url=[ff01::083]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::114]:33332/g_/s|[ff01::213]:33332/g_/s&group.limit=10&f.a_t.facet.limit=160&facet.field=a_t&version=2&group=true&group.distributed.second=true&distrib=false&fl=id&NOW=1392556599846&sort=a_si+asc,+id+asc&rows=100&isShard=true&q=*:*&group.field=a_si&facet=true&wt=javabin&start=0&group.truncate=true} status=0 QTime=11 
   [junit4]   2> 196136 T678 C502 oasc.SolrCore.execute [collection1] webapp=/g_/s path=/select params={fq=a_s:a&group.limit=10&facet.field=a_t&version=2&group=true&fl=id,a_si&sort=a_si+asc,+id+asc&rows=100&q=*:*&group.field=a_si&facet=true&shards=[ff01::083]:33332/g_/s|https://127.0.0.1:38268/g_/s|[ff01::114]:33332/g_/s|[ff01::213]:33332/g_/s&wt=javabin&group.truncate=true} status=0 QTime=22 
   [junit4]   2> 196144 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[1 (1460201429268430848)]} 0 3
   [junit4]   2> 196155 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[1 (1460201429278916608)]} 0 4
   [junit4]   2> 196161 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[2 (1460201429287305216)]} 0 2
   [junit4]   2> 196171 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[2 (1460201429296742400)]} 0 3
   [junit4]   2> 196176 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[3 (1460201429304082432)]} 0 1
   [junit4]   2> 196181 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[3 (1460201429309325312)]} 0 1
   [junit4]   2> 196188 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[4 (1460201429315616768)]} 0 2
   [junit4]   2> 196196 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[4 (1460201429324005376)]} 0 2
   [junit4]   2> 196204 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[5 (1460201429332393984)]} 0 2
   [junit4]   2> 196209 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[5 (1460201429338685440)]} 0 1
   [junit4]   2> 196215 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[6 (1460201429344976896)]} 0 1
   [junit4]   2> 196220 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[6 (1460201429350219776)]} 0 1
   [junit4]   2> 196225 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[7 (1460201429355462656)]} 0 1
   [junit4]   2> 196231 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[7 (1460201429360705536)]} 0 2
   [junit4]   2> 196236 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[8 (1460201429366996992)]} 0 1
   [junit4]   2> 196241 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[8 (1460201429372239872)]} 0 1
   [junit4]   2> 196249 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[9 (1460201429380628480)]} 0 1
   [junit4]   2> 196254 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[9 (1460201429385871360)]} 0 1
   [junit4]   2> 196261 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[10 (1460201429392162816)]} 0 2
   [junit4]   2> 196267 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[10 (1460201429399502848)]} 0 2
   [junit4]   2> 196274 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[11 (1460201429404745728)]} 0 3
   [junit4]   2> 196282 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[11 (1460201429414182912)]} 0 2
   [junit4]   2> 196291 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[12 (1460201429423620096)]} 0 2
   [junit4]   2> 196296 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[12 (1460201429429911552)]} 0 1
   [junit4]   2> 196302 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[14 (1460201429435154432)]} 0 2
   [junit4]   2> 196307 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[14 (1460201429441445888)]} 0 1
   [junit4]   2> 196313 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[15 (1460201429447737344)]} 0 1
   [junit4]   2> 196322 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[15 (1460201429456125952)]} 0 2
   [junit4]   2> 196337 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[16 (1460201429471854592)]} 0 2
   [junit4]   2> 196345 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[16 (1460201429481291776)]} 0 1
   [junit4]   2> 196353 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[17 (1460201429487583232)]} 0 4
   [junit4]   2> 196372 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[17 (1460201429508554752)]} 0 3
   [junit4]   2> 196377 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[18 (1460201429514846208)]} 0 1
   [junit4]   2> 196384 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[18 (1460201429521137664)]} 0 2
   [junit4]   2> 196392 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[19 (1460201429530574848)]} 0 1
   [junit4]   2> 196398 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[19 (1460201429536866304)]} 0 1
   [junit4]   2> 196403 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[20 (1460201429542109184)]} 0 1
   [junit4]   2> 196408 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[20 (1460201429547352064)]} 0 1
   [junit4]   2> 196415 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[21 (1460201429553643520)]} 0 3
   [junit4]   2> 196420 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[21 (1460201429559934976)]} 0 1
   [junit4]   2> 196427 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[22 (1460201429567275008)]} 0 2
   [junit4]   2> 196433 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[22 (1460201429573566464)]} 0 1
   [junit4]   2> 196438 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[23 (1460201429578809344)]} 0 1
   [junit4]   2> 196444 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[23 (1460201429584052224)]} 0 2
   [junit4]   2> 196449 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[100 (1460201429590343680)]} 0 1
   [junit4]   2> 196453 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[100 (1460201429594537984)]} 0 1
   [junit4]   2> 196458 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[101 (1460201429599780864)]} 0 1
   [junit4]   2> 196463 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[101 (1460201429605023744)]} 0 1
   [junit4]   2> 196469 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[102 (1460201429611315200)]} 0 1
   [junit4]   2> 196474 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[102 (1460201429616558080)]} 0 1
   [junit4]   2> 196480 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[103 (1460201429622849536)]} 0 2
   [junit4]   2> 196487 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[103 (1460201429629140992)]} 0 2
   [junit4]   2> 196492 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[104 (1460201429635432448)]} 0 1
   [junit4]   2> 196497 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[104 (1460201429640675328)]} 0 1
   [junit4]   2> 196506 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[105 (1460201429649063936)]} 0 2
   [junit4]   2> 196512 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[105 (1460201429656403968)]} 0 2
   [junit4]   2> 196524 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[106 (1460201429668986880)]} 0 2
   [junit4]   2> 196533 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[106 (1460201429678424064)]} 0 2
   [junit4]   2> 196539 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[107 (1460201429684715520)]} 0 1
   [junit4]   2> 196544 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[107 (1460201429689958400)]} 0 1
   [junit4]   2> 196550 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[108 (1460201429696249856)]} 0 2
   [junit4]   2> 196560 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[108 (1460201429706735616)]} 0 1
   [junit4]   2> 196574 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[109 (1460201429717221376)]} 0 6
   [junit4]   2> 196580 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[109 (1460201429726658560)]} 0 1
   [junit4]   2> 196589 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[110 (1460201429737144320)]} 0 1
   [junit4]   2> 196597 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[110 (1460201429744484352)]} 0 2
   [junit4]   2> 196621 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[111 (1460201429770698752)]} 0 1
   [junit4]   2> 196628 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[111 (1460201429778038784)]} 0 1
   [junit4]   2> 196636 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[112 (1460201429785378816)]} 0 2
   [junit4]   2> 196642 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[112 (1460201429792718848)]} 0 1
   [junit4]   2> 196649 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[113 (1460201429800058880)]} 0 1
   [junit4]   2> 196657 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[113 (1460201429808447488)]} 0 1
   [junit4]   2> 196665 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[114 (1460201429815787520)]} 0 2
   [junit4]   2> 196671 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[114 (1460201429823127552)]} 0 1
   [junit4]   2> 196677 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[115 (1460201429829419008)]} 0 1
   [junit4]   2> 196684 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[115 (1460201429836759040)]} 0 2
   [junit4]   2> 196691 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[116 (1460201429844099072)]} 0 2
   [junit4]   2> 196697 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[116 (1460201429850390528)]} 0 1
   [junit4]   2> 196704 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[117 (1460201429857730560)]} 0 1
   [junit4]   2> 196710 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[117 (1460201429864022016)]} 0 1
   [junit4]   2> 196717 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[118 (1460201429871362048)]} 0 1
   [junit4]   2> 196723 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[118 (1460201429877653504)]} 0 1
   [junit4]   2> 196729 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[119 (1460201429883944960)]} 0 1
   [junit4]   2> 196736 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[119 (1460201429891284992)]} 0 1
   [junit4]   2> 196740 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[120 (1460201429896527872)]} 0 0
   [junit4]   2> 196746 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[120 (1460201429901770752)]} 0 1
   [junit4]   2> 196751 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[121 (1460201429907013632)]} 0 1
   [junit4]   2> 196755 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[121 (1460201429911207936)]} 0 1
   [junit4]   2> 196761 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[122 (1460201429917499392)]} 0 2
   [junit4]   2> 196766 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[122 (1460201429922742272)]} 0 2
   [junit4]   2> 196770 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[123 (1460201429927985152)]} 0 1
   [junit4]   2> 196776 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[123 (1460201429933228032)]} 0 1
   [junit4]   2> 196781 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[124 (1460201429938470912)]} 0 1
   [junit4]   2> 196786 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[124 (1460201429943713792)]} 0 1
   [junit4]   2> 196792 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[125 (1460201429948956672)]} 0 2
   [junit4]   2> 196798 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[125 (1460201429956296704)]} 0 2
   [junit4]   2> 196803 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[126 (1460201429961539584)]} 0 1
   [junit4]   2> 196807 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[126 (1460201429965733888)]} 0 1
   [junit4]   2> 196813 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[127 (1460201429972025344)]} 0 1
   [junit4]   2> 196818 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[127 (1460201429977268224)]} 0 1
   [junit4]   2> 196823 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[128 (1460201429982511104)]} 0 1
   [junit4]   2> 196828 T678 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[128 (1460201429987753984)]} 0 2
   [junit4]   2> 196832 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[129 (1460201429992996864)]} 0 1
   [junit4]   2> 196837 T682 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[129 (1460201429997191168)]} 0 1
   [junit4]   2> 196842 T667 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[130 (1460201430002434048)]} 0 1
   [junit4]   2> 196847 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[130 (1460201430007676928)]} 0 1
   [junit4]   2> 196854 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[131 (1460201430013968384)]} 0 2
   [junit4]   2> 196859 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[131 (1460201430020259840)]} 0 1
   [junit4]   2> 196869 T669 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[132 (1460201430030745600)]} 0 1
   [junit4]   2> 196876 T681 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[132 (1460201430038085632)]} 0 1
   [junit4]   2> 196883 T670 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[133 (1460201430045425664)]} 0 1
   [junit4]   2> 196888 T679 C502 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[133 (1460201430051717120)]} 0 1
   [junit4]   2> 196893 T668 C501 oasup.LogUpdateProcessor.finish [collection1] webapp=/g_/s path=/update params={version=2&wt=javabin} {add=[134 (1460

[...truncated too long message...]

te
   [junit4]   2> 1057476 T3357 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1057476 T3357 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1057477 T3357 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1057478 T3357 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1057478 T3357 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1392557449017/shard1/data [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1392557449017/shard1/data;done=false>>]
   [junit4]   2> 1057478 T3357 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1392557449017/shard1/data
   [junit4]   2> 1057478 T3357 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1392557449017/shard1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1392557449017/shard1/data/index;done=false>>]
   [junit4]   2> 1057479 T3357 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1392557449017/shard1/data/index
   [junit4]   2> 1057479 T3357 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/is/o,null}
   [junit4]   2> 1057538 T3357 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedSearch -Dtests.method=testDistribSearch -Dtests.seed=A60596B27F4B6CF9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ro_RO -Dtests.timezone=Asia/Qyzylorda -Dtests.file.encoding=UTF-8
   [junit4] ERROR   12.1s J0 | TestDistributedSearch.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 500 Server Error</title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 500</h2>
   [junit4]    > <p>Problem accessing /is/o/select. Reason:
   [junit4]    > <pre>    Server Error</pre></p>
   [junit4]    > <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([A60596B27F4B6CF9:27E318AA08140CC5]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]    > 	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:177)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 1057544 T3357 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene46: {range_facet_sl=Lucene41(blocksize=128), n_tdt1=MockFixedIntBlock(blockSize=878), lowerfilt=FST41, n_f1=MockFixedIntBlock(blockSize=878), range_facet_l=FST41, intDefault=MockFixedIntBlock(blockSize=878), n_dt1=MockFixedIntBlock(blockSize=878), foo_f=PostingsFormat(name=Lucene41WithOrds), a_n_tdt=PostingsFormat(name=Lucene41WithOrds), SubjectTerms_mfacet=MockFixedIntBlock(blockSize=878), n_d1=FST41, b_n_tdt=MockFixedIntBlock(blockSize=878), oddField_s=Lucene41(blocksize=128), rnd_b=Lucene41(blocksize=128), n_td1=MockFixedIntBlock(blockSize=878), id=Lucene41(blocksize=128), a_si=MockFixedIntBlock(blockSize=878), text=PostingsFormat(name=Lucene41WithOrds), n_l1=FST41, n_tl1=MockFixedIntBlock(blockSize=878), a_t=FST41, n_ti1=Lucene41(blocksize=128), range_facet_si=FST41, multiDefault=FST41, timestamp=FST41, foo_b=PostingsFormat(name=Lucene41WithOrds), _version_=MockFixedIntBlock(blockSize=878), lowerfilt1and2=FST41, other_tl1=MockFixedIntBlock(blockSize=878), foo_d=Lucene41(blocksize=128), n_tf1=FST41}, docValues:{}, sim=DefaultSimilarity, locale=ro_RO, timezone=Asia/Qyzylorda
   [junit4]   2> NOTE: Linux 3.8.0-35-generic amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=8,threads=1,free=269758168,total=483393536
   [junit4]   2> NOTE: All tests run in this JVM: [ZkControllerTest, BasicFunctionalityTest, TestSuggestSpellingConverter, TestRemoteStreaming, TestLFUCache, DocumentBuilderTest, TestExtendedDismaxParser, TestDefaultSearchFieldResource, BinaryUpdateRequestHandlerTest, LeaderElectionTest, SchemaVersionSpecificBehaviorTest, DocValuesTest, TestFaceting, SoftAutoCommitTest, TestFunctionQuery, MBeansHandlerTest, TestSolrQueryParser, TestLuceneMatchVersion, TestDocSet, MoreLikeThisHandlerTest, TestDocumentBuilder, TestFieldCollectionResource, ParsingFieldUpdateProcessorsTest, TestHighFrequencyDictionaryFactory, TestNoOpRegenerator, TestPseudoReturnFields, RemoteQueryErrorTest, CoreAdminHandlerTest, QueryEqualityTest, DateMathParserTest, ShardRoutingTest, TestLRUCache, ResponseLogComponentTest, SearchHandlerTest, AutoCommitTest, CircularListTest, TestSchemaVersionResource, TestStandardQParsers, URLClassifyProcessorTest, SliceStateUpdateTest, LegacyHTMLStripCharFilterTest, SuggestComponentTest, JsonLoaderTest, ShowFileRequestHandlerTest, ClusterStateTest, UUIDFieldTest, DistribCursorPagingTest, SolrIndexSplitterTest, DeleteReplicaTest, TestSolrXMLSerializer, SolrInfoMBeanTest, InfoHandlerTest, SuggesterFSTTest, SOLR749Test, DeleteShardTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, AddSchemaFieldsUpdateProcessorFactoryTest, WordBreakSolrSpellCheckerTest, CoreAdminCreateDiscoverTest, TestNonNRTOpen, TestMergePolicyConfig, UnloadDistributedZkTest, TestReplicationHandler, FieldMutatingUpdateProcessorTest, EnumFieldTest, LoggingHandlerTest, TestCustomSort, BasicDistributedZkTest, TestRandomDVFaceting, FastVectorHighlighterTest, RegexBoostProcessorTest, LukeRequestHandlerTest, TestPHPSerializedResponseWriter, RecoveryZkTest, TestBadConfig, OverseerCollectionProcessorTest, SampleTest, ClusterStateUpdateTest, TermsComponentTest, DirectUpdateHandlerOptimizeTest, BadComponentTest, BlockCacheTest, TestWriterPerf, DistributedDebugComponentTest, TestQueryUtils, TestAnalyzeInfixSuggestions, OverseerTest, BasicZkTest, TestRandomFaceting, ShardRoutingCustomTest, TestDistributedSearch]
   [junit4] Completed on J0 in 12.17s, 1 test, 1 error <<< FAILURES!

[...truncated 541 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 362 suites, 1563 tests, 4 errors, 35 ignored (7 assumptions)

Total time: 50 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0-fcs-b129) - Build # 9392 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9392/
Java: 64bit/jdk1.8.0-fcs-b129 -XX:-UseCompressedOops -XX:+UseG1GC

5 tests failed.
FAILED:  org.apache.solr.cloud.DistribCursorPagingTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:46270/collection1, http://127.0.0.1:54420/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:46270/collection1, http://127.0.0.1:54420/collection1]
	at __randomizedtesting.SeedInfo.seed([B8AAAD58FF4DF506:394C23408812953A]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:532)
	at org.apache.solr.cloud.DistribCursorPagingTest.doSimpleTest(DistribCursorPagingTest.java:257)
	at org.apache.solr.cloud.DistribCursorPagingTest.doTest(DistribCursorPagingTest.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 49 more


FAILED:  org.apache.solr.TestDistributedGrouping.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([B8AAAD58FF4DF506:394C23408812953A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedGrouping.doTest(TestDistributedGrouping.java:156)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /phjqd/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /phjqd/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([B8AAAD58FF4DF506:394C23408812953A]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:177)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:59585/b/collection1, https://127.0.0.1:36116/b/collection1, https://127.0.0.1:33794/b/collection1, https://127.0.0.1:41327/b/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:59585/b/collection1, https://127.0.0.1:36116/b/collection1, https://127.0.0.1:33794/b/collection1, https://127.0.0.1:41327/b/collection1]
	at __randomizedtesting.SeedInfo.seed([B8AAAD58FF4DF506:394C23408812953A]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkQueries(AbstractFullDistribZkTestBase.java:797)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:101)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /b/collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 50 more


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:58846/collection1, https://127.0.0.1:42790/collection1, https://127.0.0.1:42030/collection1, https://127.0.0.1:59292/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:58846/collection1, https://127.0.0.1:42790/collection1, https://127.0.0.1:42030/collection1, https://127.0.0.1:59292/collection1]
	at __randomizedtesting.SeedInfo.seed([B8AAAD58FF4DF506:394C23408812953A]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.cloud.BasicDistributedZkTest.queryServer(BasicDistributedZkTest.java:1171)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:264)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 49 more




Build Log:
[...truncated 10066 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> 12943 T56 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 12944 T56 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /b/
   [junit4]   2> 12951 T56 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1392584850812
   [junit4]   2> 12956 T56 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 12959 T57 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 13058 T56 oasc.ZkTestServer.run start zk server on port:57661
   [junit4]   2> 13129 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 13164 T58 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
   [junit4]   2> 15181 T63 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@421d8a76 name:ZooKeeperConnection Watcher:127.0.0.1:57661 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 15181 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 15183 T56 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 15216 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 15224 T65 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@203c7622 name:ZooKeeperConnection Watcher:127.0.0.1:57661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 15225 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 15231 T56 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 15237 T56 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 15242 T56 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 15246 T56 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 15251 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 15261 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 15268 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 15268 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 15273 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 15273 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 15279 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 15280 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 15284 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 15284 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 15288 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 15289 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 15296 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 15296 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 15300 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 15301 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 15305 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 15305 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 15309 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 15310 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 15314 T56 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 15315 T56 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 15323 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 15327 T67 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@172f240c name:ZooKeeperConnection Watcher:127.0.0.1:57661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 15328 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 15567 T56 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 16000 T56 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 16069 T56 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:36889
   [junit4]   2> 16179 T56 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 16180 T56 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 16180 T56 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190
   [junit4]   2> 16181 T56 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/'
   [junit4]   2> 16229 T56 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/solr.xml
   [junit4]   2> 16249 T56 oasc.CoreContainer.<init> New CoreContainer 149891472
   [junit4]   2> 16250 T56 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/]
   [junit4]   2> 16284 T56 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 16285 T56 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 16286 T56 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 16286 T56 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 16287 T56 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 16287 T56 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 16287 T56 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 16288 T56 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 16288 T56 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 16301 T56 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 16301 T56 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 16302 T56 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 16302 T56 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57661/solr
   [junit4]   2> 16317 T56 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 16325 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16338 T79 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@714a968e name:ZooKeeperConnection Watcher:127.0.0.1:57661 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16339 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16353 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16356 T81 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64753682 name:ZooKeeperConnection Watcher:127.0.0.1:57661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16357 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16364 T56 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 16379 T56 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 16394 T56 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 16397 T56 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36889_b
   [junit4]   2> 16402 T56 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36889_b
   [junit4]   2> 16407 T56 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 16412 T56 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 16427 T56 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:36889_b
   [junit4]   2> 16428 T56 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 16441 T56 oasc.Overseer.start Overseer (id=91264440791072772-127.0.0.1:36889_b-n_0000000000) starting
   [junit4]   2> 16458 T56 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 16498 T82 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 16513 T83 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 16515 T56 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 16515 T83 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 16523 T56 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 16526 T56 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 16552 T84 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 16552 T84 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 16558 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 16558 T84 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 16562 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 16564 T82 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:36889/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:36889_b",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 16565 T82 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 16579 T82 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 16586 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 16592 T81 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 17563 T84 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 17564 T84 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/collection1
   [junit4]   2> 17564 T84 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 17565 T84 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 17565 T84 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 17566 T84 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 17567 T84 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/collection1/'
   [junit4]   2> 17568 T84 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/collection1/lib/classes/' to classloader
   [junit4]   2> 17568 T84 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/collection1/lib/README' to classloader
   [junit4]   2> 17600 T84 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 17616 T84 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 17618 T84 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 17635 T84 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 17890 T84 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 17891 T84 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 17892 T84 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 17901 T84 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 17903 T84 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 17951 T84 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 17960 T84 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 17966 T84 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 17968 T84 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 17969 T84 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 17969 T84 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 17971 T84 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 17972 T84 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 17972 T84 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 17973 T84 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1392584853190/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/control/data/
   [junit4]   2> 17993 T84 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e227cf4
   [junit4]   2> 18009 T84 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/control/data
   [junit4]   2> 18009 T84 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/control/data/index/
   [junit4]   2> 18009 T84 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 18010 T84 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/control/data/index
   [junit4]   2> 18011 T84 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1206422031, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 18012 T84 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3a77990e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1bbfeda4),segFN=segments_1,generation=1}
   [junit4]   2> 18013 T84 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 18020 T84 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 18037 T84 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 18038 T84 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 18038 T84 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 18038 T84 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 18039 T84 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 18039 T84 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 18040 T84 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 18040 T84 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 18044 T84 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 18045 T84 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 18045 T84 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 18046 T84 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 18047 T84 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 18048 T84 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 18049 T84 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 18051 T84 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 18064 T84 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 18064 T84 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 18066 T84 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 18066 T84 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3a77990e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1bbfeda4),segFN=segments_1,generation=1}
   [junit4]   2> 18067 T84 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 18067 T84 oass.SolrIndexSearcher.<init> Opening Searcher@3ed62bdf[collection1] main
   [junit4]   2> 18073 T85 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ed62bdf[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 18078 T84 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 18080 T56 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 18080 T88 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:36889/b collection:control_collection shard:shard1
   [junit4]   2> 18080 T56 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 18088 T88 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 18102 T88 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 18106 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18107 T88 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 18108 T88 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 18108 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 18111 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> ASYNC  NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@2ab36d6f url=https://127.0.0.1:36889/b/collection1 node=127.0.0.1:36889_b C8_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:36889/b, core=collection1, node_name=127.0.0.1:36889_b}
   [junit4]   2> 18113 T88 C8 P36889 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:36889/b/collection1/
   [junit4]   2> 18114 T90 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9385c31 name:ZooKeeperConnection Watcher:127.0.0.1:57661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 18114 T88 C8 P36889 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 18115 T88 C8 P36889 oasc.SyncStrategy.syncToMe https://127.0.0.1:36889/b/collection1/ has no replicas
   [junit4]   2> 18115 T88 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:36889/b/collection1/ shard1
   [junit4]   2> 18116 T88 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 18115 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 18123 T56 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 18129 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18132 T81 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 18136 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 18142 T56 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 18148 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18160 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 18164 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18255 T56 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 18256 T56 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 18265 T56 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 18267 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 18267 T81 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 18273 T56 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:33794
   [junit4]   2> 18283 T56 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 18283 T56 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 18284 T56 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001
   [junit4]   2> 18284 T56 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/'
   [junit4]   2> 18307 T56 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/solr.xml
   [junit4]   2> 18310 T88 oasc.ZkController.register We are https://127.0.0.1:36889/b/collection1/ and leader is https://127.0.0.1:36889/b/collection1/
   [junit4]   2> 18311 T88 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:36889/b
   [junit4]   2> 18312 T88 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 18312 T88 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 18312 T88 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 18315 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18315 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18316 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18316 T88 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 18318 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 18320 T82 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:36889/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:36889_b",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 18324 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 18326 T56 oasc.CoreContainer.<init> New CoreContainer 1299498737
   [junit4]   2> 18326 T56 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/]
   [junit4]   2> 18327 T56 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 18328 T56 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 18328 T56 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 18329 T56 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 18329 T56 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 18329 T56 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 18330 T56 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 18330 T56 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 18331 T56 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 18337 T56 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 18339 T56 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 18339 T56 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 18340 T56 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57661/solr
   [junit4]   2> 18340 T56 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 18344 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 18347 T101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@537ab0fe name:ZooKeeperConnection Watcher:127.0.0.1:57661 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 18348 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 18351 T56 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 18355 T103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e247ce4 name:ZooKeeperConnection Watcher:127.0.0.1:57661/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 18355 T56 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 18362 T56 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 18428 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 18428 T81 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 18429 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 19366 T56 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33794_b
   [junit4]   2> 19367 T56 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33794_b
   [junit4]   2> 19375 T90 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 19375 T103 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 19375 T81 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 19388 T104 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 19388 T104 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 19390 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 19390 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 19390 T104 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 19391 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 19392 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 19394 T82 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:33794/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:33794_b",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 19394 T82 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 19394 T82 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 19402 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 19505 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 19505 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 19505 T81 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 20391 T104 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 20392 T104 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/collection1
   [junit4]   2> 20392 T104 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 20393 T104 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 20393 T104 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 20394 T104 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 20395 T104 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/collection1/'
   [junit4]   2> 20395 T104 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/collection1/lib/classes/' to classloader
   [junit4]   2> 20396 T104 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/collection1/lib/README' to classloader
   [junit4]   2> 20438 T104 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 20454 T104 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 20457 T104 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 20487 T104 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 20801 T104 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 20802 T104 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 20803 T104 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 20818 T104 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 20824 T104 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 20861 T104 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 20866 T104 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 20870 T104 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 20873 T104 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 20873 T104 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 20873 T104 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 20875 T104 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 20876 T104 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 20876 T104 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 20876 T104 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1392584856001/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/jetty1/
   [junit4]   2> 20877 T104 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6e227cf4
   [junit4]   2> 20895 T104 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/jetty1
   [junit4]   2> 20896 T104 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/jetty1/index/
   [junit4]   2> 20896 T104 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 20896 T104 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1392584850811/jetty1/index
   [junit4]   2> 20897 T104 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1206422031, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 20898 T104 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@748d6ca7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a69966),segFN=segments_1,generation=1}
   [junit4]   2> 20899 T104 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 20911 T104 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 20912 T104 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 20912 T104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 20912 T104 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 20913 T104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 20913 T104 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 20914 T104 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 20915 T104 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 20915 T104 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 20917 T104 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 20918 T104 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 20918 T104 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 20919 T104 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 20920 T104 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 20921 T104 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 20923 T104 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 20926 T104 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 20930 T104 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 20930 T104 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 20935 T104 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 20937 T104 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@748d6ca7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a69966),segFN=segments_1,generation=1}
   [junit4]   2> 20938 T104 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 20938 T104 oass.SolrIndexSearcher.<init> Opening Searcher@46459a79[collection1] main
   [junit4]   2> 20946 T105 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46459a79[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 20952 T104 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 20953 T56 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 20953 T56 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 20953 T108 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:33794/b collection:collection1 shard:shard2
   [junit4]   2> 20955 T108 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 20977 T108 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 20983 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20983 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20983 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20983 T108 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 20984 T108 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@3c1cf6fb url=https://127.0.0.1:33794/b/collection1 node=127.0.0.1:33794_b C9_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:33794/b, core=collection1, node_name=127.0.0.1:33794_b}
   [junit4]   2> 20984 T108 C9 P33794 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:33794/b/collection1/
   [junit4]   2> 20992 T108 C9 P33794 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 20992 T108 C9 P33794 oasc.SyncStrategy.syncToMe https://127.0.0.1:33794/b/collection1/ has no replicas
   [junit4]   2> 20992 T108 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:33794/b/collection1/ shard2
   [junit4]   2> 20993 T108 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 20993 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 21001 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 21023 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 21029 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 21039 T90 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 21039 T81 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 21041 T103 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 21075 T108 oasc.ZkController.register We are https://127.0.0.1:33794/b/collection1/ and leader is https://127.0.0.1:33794/b/collection1/
   [junit4]   2> 21076 T108 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:33794/b
   [junit4]   2> 21076 T108 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 21076 T108 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 21076 T108 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 21078 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 21079 T108 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 21081 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 21083 T82 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:33794/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:33794_b",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 21087 T81 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 21145 T56 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 21147 T56 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 21154 T56 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 21158 T56 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:59585
   [junit4]   2> 21164 T56 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 21165 T56 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 21165 T56 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1392584858815
   [junit4]   2> 21166 T56 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1392584858815/'
   [junit4]   2> 21184 T56 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1392584858815/solr.xml
   [junit4]   2> 21190 T81 oascc.ZkStateReader$2.process A c

[...truncated too long message...]

 Closing directory: ./org.apache.solr.TestDistributedSearch-1392585729751/shard0/data/index
   [junit4]   2> 896744 T4000 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/phjqd,null}
   [junit4]   2> 896816 T4000 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1844518859
   [junit4]   2> 896817 T4000 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@517dca96
   [junit4]   2> 896826 T4000 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=34,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=8704,transaction_logs_total_number=2}
   [junit4]   2> 896827 T4000 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 896827 T4000 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 896827 T4000 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 896828 T4000 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 896828 T4000 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 896829 T4000 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1392585729751/shard1/data [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1392585729751/shard1/data;done=false>>]
   [junit4]   2> 896829 T4000 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1392585729751/shard1/data
   [junit4]   2> 896829 T4000 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.TestDistributedSearch-1392585729751/shard1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.TestDistributedSearch-1392585729751/shard1/data/index;done=false>>]
   [junit4]   2> 896829 T4000 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.TestDistributedSearch-1392585729751/shard1/data/index
   [junit4]   2> 896831 T4000 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/phjqd,null}
   [junit4]   2> 896892 T4000 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedSearch -Dtests.method=testDistribSearch -Dtests.seed=B8AAAD58FF4DF506 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_ME -Dtests.timezone=Asia/Thimphu -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   5.95s J0 | TestDistributedSearch.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 500 Server Error</title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 500</h2>
   [junit4]    > <p>Problem accessing /phjqd/select. Reason:
   [junit4]    > <pre>    Server Error</pre></p>
   [junit4]    > <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B8AAAD58FF4DF506:394C23408812953A]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]    > 	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:177)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 896899 T4000 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=sr_ME, timezone=Asia/Thimphu
   [junit4]   2> NOTE: Linux 3.8.0-35-generic amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=8,threads=1,free=150661880,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestSuggestSpellingConverter, TestSimpleQParserPlugin, QueryElevationComponentTest, CircularListTest, HdfsChaosMonkeySafeLeaderTest, TestConfig, FieldMutatingUpdateProcessorTest, TestRandomDVFaceting, RecoveryZkTest, SpellPossibilityIteratorTest, TestAnalyzeInfixSuggestions, HdfsDirectoryTest, TestRandomMergePolicy, TestQueryUtils, WordBreakSolrSpellCheckerTest, SliceStateTest, SynonymTokenizerTest, AnalysisAfterCoreReloadTest, TestLuceneMatchVersion, PolyFieldTest, TestFieldTypeResource, CustomCollectionTest, UpdateParamsTest, TermVectorComponentTest, TestJoin, TestDistribDocBasedVersion, ChangedSchemaMergeTest, TestLFUCache, RegexBoostProcessorTest, MoreLikeThisHandlerTest, TestSystemIdResolver, TestNonNRTOpen, TestLRUCache, QueryEqualityTest, TestPseudoReturnFields, IndexSchemaTest, TestCopyFieldCollectionResource, ParsingFieldUpdateProcessorsTest, TestValueSourceCache, InfoHandlerTest, TestSolrQueryParser, SuggesterTest, SuggesterFSTTest, CoreAdminCreateDiscoverTest, TestGroupingSearch, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, PeerSyncTest, TestElisionMultitermQuery, TestBlendedInfixSuggestions, CursorPagingTest, CSVRequestHandlerTest, SolrInfoMBeanTest, AutoCommitTest, SOLR749Test, TestStressVersions, TestFieldCollectionResource, TestRealTimeGet, TestPostingsSolrHighlighter, TestCoreContainer, ShardRoutingTest, TestMergePolicyConfig, StressHdfsTest, AddSchemaFieldsUpdateProcessorFactoryTest, SystemInfoHandlerTest, DOMUtilTest, LeaderElectionTest, TestCharFilters, TestClassNameShortening, TestPHPSerializedResponseWriter, TestSchemaSimilarityResource, TestTrie, TestSearchPerf, TestSurroundQueryParser, DistribCursorPagingTest, SolrCoreTest, TestHighlightDedupGrouping, BasicDistributedZkTest, ZkControllerTest, OverseerCollectionProcessorTest, BadCopyFieldTest, TestSolrQueryParserResource, SimpleFacetsTest, TestStandardQParsers, DistributedTermsComponentTest, TestSort, CoreAdminHandlerTest, MBeansHandlerTest, UnloadDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, TestReplicationHandler, ClusterStateUpdateTest, ZkSolrClientTest, ShardRoutingCustomTest, SliceStateUpdateTest, TestDistributedSearch]
   [junit4] Completed on J0 in 5.97s, 1 test, 1 error <<< FAILURES!

[...truncated 524 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 362 suites, 1563 tests, 5 errors, 35 ignored (7 assumptions)

Total time: 47 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b129 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/ibm-j9-jdk7) - Build # 9391 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9391/
Java: 64bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}

1 tests failed.
REGRESSION:  org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.testDupeDetection

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([406CCC1BF787BBDA:1B5C37D3F4C018A6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.checkNumDocs(SignatureUpdateProcessorFactoryTest.java:71)
	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.testDupeDetection(SignatureUpdateProcessorFactoryTest.java:119)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
	at java.lang.reflect.Method.invoke(Method.java:613)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:780)




Build Log:
[...truncated 10594 lines...]
   [junit4] Suite: org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest
   [junit4]   2> 619072 T1911 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 619073 T1911 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368
   [junit4]   2> 619074 T1911 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 619075 T1911 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 619076 T1911 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 619127 T1911 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 619190 T1911 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 619191 T1911 oass.IndexSchema.readSchema Reading Solr Schema from schema12.xml
   [junit4]   2> 619197 T1911 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 619485 T1911 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 619487 T1911 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 619488 T1911 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 619493 T1911 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 619497 T1911 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 619500 T1911 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 619500 T1911 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 619501 T1911 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 619537 T1911 oasc.CoreContainer.<init> New CoreContainer 18798139
   [junit4]   2> 619538 T1911 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 619539 T1911 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 619539 T1911 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 619539 T1911 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 619540 T1911 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 619540 T1911 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 619540 T1911 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 619540 T1911 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 619541 T1911 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 619541 T1911 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 619545 T1911 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 619546 T1911 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 619546 T1911 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 619549 T1912 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 619550 T1912 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 619550 T1912 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 619551 T1912 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 619595 T1912 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 619639 T1912 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 619639 T1912 oass.IndexSchema.readSchema Reading Solr Schema from schema12.xml
   [junit4]   2> 619645 T1912 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 619924 T1912 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 619926 T1912 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 619928 T1912 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 619937 T1912 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 619940 T1912 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 619944 T1912 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 619944 T1912 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/
   [junit4]   2> 619944 T1912 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@163af2c
   [junit4]   2> 619945 T1912 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368
   [junit4]   2> 619945 T1912 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/index/
   [junit4]   2> 619946 T1912 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/index' doesn't exist. Creating new index...
   [junit4]   2> 619946 T1912 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/index
   [junit4]   2> 619946 T1912 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=17.5517578125, floorSegmentMB=2.056640625, forceMergeDeletesPctAllowed=13.11443158636604, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 619947 T1912 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_1,generation=1}
   [junit4]   2> 619947 T1912 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 619948 T1912 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 619949 T1912 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 619950 T1912 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 619950 T1912 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 619950 T1912 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 619951 T1912 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 619951 T1912 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 619951 T1912 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 619952 T1912 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 619952 T1912 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 619952 T1912 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 619952 T1912 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 619953 T1912 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 619953 T1912 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 619953 T1912 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 619954 T1912 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 619954 T1912 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 619954 T1912 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 619955 T1912 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 619955 T1912 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 619956 T1912 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 619956 T1912 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 619956 T1912 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 619957 T1912 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 619957 T1912 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 619957 T1912 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 619957 T1912 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 619958 T1912 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619958 T1912 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619959 T1912 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619959 T1912 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619959 T1912 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619960 T1912 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619960 T1912 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619960 T1912 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 619961 T1912 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 619961 T1912 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 619962 T1912 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 619964 T1912 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 619965 T1912 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 619965 T1912 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 619966 T1912 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8132713125622723]
   [junit4]   2> 619966 T1912 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_1,generation=1}
   [junit4]   2> 619967 T1912 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 619967 T1912 oass.SolrIndexSearcher.<init> Opening Searcher@e5b5a50f[collection1] main
   [junit4]   2> 619968 T1912 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 620125 T1912 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 620141 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e5b5a50f[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 620144 T1912 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 620145 T1911 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 620148 T1911 oas.SolrTestCaseJ4.setUp ###Starting testMultiThreaded
   [junit4]   2> ASYNC  NEW_CORE C1113 name=collection1 org.apache.solr.core.SolrCore@c41398f6
   [junit4]   2> 620148 T1911 C1113 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 620149 T1911 C1113 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 620152 T1911 C1113 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620153 T1911 C1113 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_2,generation=2}
   [junit4]   2> 620153 T1911 C1113 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 620154 T1911 C1113 oass.SolrIndexSearcher.<init> Opening Searcher@5d91d59b[collection1] main
   [junit4]   2> 620154 T1911 C1113 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620155 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d91d59b[collection1] main{StandardDirectoryReader(segments_2:2:nrt)}
   [junit4]   2> 620156 T1911 C1113 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 620163 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620196 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_3,generation=3}
   [junit4]   2> 620197 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 620265 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@dcbd471e[collection1] main
   [junit4]   2> 620266 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620268 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@dcbd471e[collection1] main{StandardDirectoryReader(segments_3:26:nrt _7(4.7):c33/31:delGen=1 _5(4.7):c20/19:delGen=1)}
   [junit4]   2> 620268 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620291 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_4,generation=4}
   [junit4]   2> 620292 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 620294 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@54ff1f8e[collection1] main
   [junit4]   2> 620294 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620296 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54ff1f8e[collection1] main{StandardDirectoryReader(segments_4:35:nrt _a(4.7):c82/79:delGen=1 _c(4.7):c1)}
   [junit4]   2> 620297 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620297 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_4,generation=4}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_5,generation=5}
   [junit4]   2> 620298 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
   [junit4]   2> 620298 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@bca8913b[collection1] main
   [junit4]   2> 620299 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620300 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620301 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bca8913b[collection1] main{StandardDirectoryReader(segments_4:35:nrt _a(4.7):c82/79:delGen=2 _c(4.7):c1)}
   [junit4]   2> 620302 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_5,generation=5}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_6,generation=6}
   [junit4]   2> 620303 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
   [junit4]   2> 620305 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@516d60cd[collection1] main
   [junit4]   2> 620306 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620306 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620307 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_6,generation=6}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_7,generation=7}
   [junit4]   2> 620307 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@516d60cd[collection1] main{StandardDirectoryReader(segments_6:43:nrt _a(4.7):c82/79:delGen=2 _e(4.7):c1)}
   [junit4]   2> 620308 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
   [junit4]   2> 620309 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@25d160f1[collection1] main
   [junit4]   2> 620309 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620310 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620310 T1922 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620311 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@25d160f1[collection1] main{StandardDirectoryReader(segments_6:43:nrt _a(4.7):c82/79:delGen=2 _e(4.7):c1)}
   [junit4]   2> 620312 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@ce5841c7[collection1] main
   [junit4]   2> 620312 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620314 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620316 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ce5841c7[collection1] main{StandardDirectoryReader(segments_6:43:nrt _a(4.7):c82/79:delGen=2 _e(4.7):c1)}
   [junit4]   2> 620319 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_7,generation=7}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_8,generation=8}
   [junit4]   2> 620320 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 8
   [junit4]   2> 620322 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@b8ce2866[collection1] main
   [junit4]   2> 620324 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620325 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620326 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_8,generation=8}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_9,generation=9}
   [junit4]   2> 620325 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b8ce2866[collection1] main{StandardDirectoryReader(segments_8:53:nrt _a(4.7):c82/81:delGen=3 _e(4.7):c1 _h(4.7):c1)}
   [junit4]   2> 620327 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 9
   [junit4]   2> 620329 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@c45f6370[collection1] main
   [junit4]   2> 620333 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c45f6370[collection1] main{StandardDirectoryReader(segments_8:53:nrt _a(4.7):c82/81:delGen=3 _e(4.7):c1 _h(4.7):c1)}
   [junit4]   2> 620333 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620334 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620336 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_9,generation=9}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_a,generation=10}
   [junit4]   2> 620337 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 10
   [junit4]   2> 620339 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@b902026e[collection1] main
   [junit4]   2> 620340 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620340 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620341 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_a,generation=10}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_b,generation=11}
   [junit4]   2> 620341 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b902026e[collection1] main{StandardDirectoryReader(segments_a:61:nrt _a(4.7):c82/81:delGen=3 _j(4.7):c1)}
   [junit4]   2> 620342 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 11
   [junit4]   2> 620343 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@65e4bdf3[collection1] main
   [junit4]   2> 620343 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620344 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620344 T1924 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620345 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65e4bdf3[collection1] main{StandardDirectoryReader(segments_a:61:nrt _a(4.7):c82/81:delGen=3 _j(4.7):c1)}
   [junit4]   2> 620347 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@d9625f80[collection1] main
   [junit4]   2> 620347 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620348 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620349 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d9625f80[collection1] main{StandardDirectoryReader(segments_b:65:nrt _a(4.7):c82/81:delGen=3 _k(4.7):c1)}
   [junit4]   2> 620350 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_b,generation=11}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_c,generation=12}
   [junit4]   2> 620351 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 12
   [junit4]   2> 620353 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@7f028bb3[collection1] main
   [junit4]   2> 620354 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620355 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620355 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f028bb3[collection1] main{StandardDirectoryReader(segments_c:71:nrt _a(4.7):c82/81:delGen=3 _l(4.7):c1 _m(4.7):c1)}
   [junit4]   2> 620356 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_c,generation=12}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_d,generation=13}
   [junit4]   2> 620356 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 13
   [junit4]   2> 620357 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@517678fd[collection1] main
   [junit4]   2> 620358 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620358 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620359 T1924 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620359 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@517678fd[collection1] main{StandardDirectoryReader(segments_d:73:nrt _a(4.7):c82/81:delGen=3 _m(4.7):c1)}
   [junit4]   2> 620361 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@317dc546[collection1] main
   [junit4]   2> 620361 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620362 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620363 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@317dc546[collection1] main{StandardDirectoryReader(segments_d:77:nrt _a(4.7):c82/81:delGen=3 _n(4.7):c1)}
   [junit4]   2> 620364 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_d,generation=13}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_e,generation=14}
   [junit4]   2> 620364 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 14
   [junit4]   2> 620365 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@9804e68b[collection1] main
   [junit4]   2> 620366 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620367 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620367 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9804e68b[collection1] main{StandardDirectoryReader(segments_e:79:nrt _a(4.7):c82/81:delGen=3 _n(4.7):c1 _o(4.7):c1)}
   [junit4]   2> 620369 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_e,generation=14}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_f,generation=15}
   [junit4]   2> 620370 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 15
   [junit4]   2> 620371 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@3e5b6a7f[collection1] main
   [junit4]   2> 620372 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620372 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620372 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_f,generation=15}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_g,generation=16}
   [junit4]   2> 620373 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 16
   [junit4]   2> 620373 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e5b6a7f[collection1] main{StandardDirectoryReader(segments_f:87:nrt _a(4.7):c82/81:delGen=3 _n(4.7):c1 _q(4.7):c1)}
   [junit4]   2> 620374 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@2bcc1aa1[collection1] main
   [junit4]   2> 620374 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620375 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620375 T1922 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620376 T1922 oasc.SolrCore.getSearcher WARN [collection1] PERFORMANCE WARNING: Overlapping onDeckSearchers=2
   [junit4]   2> 620378 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@5f702e8d[collection1] main
   [junit4]   2> 620379 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bcc1aa1[collection1] main{StandardDirectoryReader(segments_f:87:nrt _a(4.7):c82/81:delGen=3 _n(4.7):c1 _q(4.7):c1)}
   [junit4]   2> 620379 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620381 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f702e8d[collection1] main{StandardDirectoryReader(segments_g:91:nrt _n(4.7):c1 _q(4.7):c1 _r(4.7):c1)}
   [junit4]   2> 620387 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620390 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_g,generation=16}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_h,generation=17}
   [junit4]   2> 620390 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 17
   [junit4]   2> 620392 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@fdfc526c[collection1] main
   [junit4]   2> 620393 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620394 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620394 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fdfc526c[collection1] main{StandardDirectoryReader(segments_h:99:nrt _n(4.7):c1 _q(4.7):c1 _t(4.7):c1)}
   [junit4]   2> 620394 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_h,generation=17}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_i,generation=18}
   [junit4]   2> 620395 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 18
   [junit4]   2> 620395 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@4551cef9[collection1] main
   [junit4]   2> 620396 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620396 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620396 T1922 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620396 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4551cef9[collection1] main{StandardDirectoryReader(segments_h:99:nrt _n(4.7):c1 _q(4.7):c1 _t(4.7):c1)}
   [junit4]   2> 620399 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@5ea94891[collection1] main
   [junit4]   2> 620399 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620400 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620400 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ea94891[collection1] main{StandardDirectoryReader(segments_i:101:nrt _n(4.7):c1 _q(4.7):c1 _t(4.7):c1 _u(4.7):c1)}
   [junit4]   2> 620402 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_i,generation=18}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_j,generation=19}
   [junit4]   2> 620403 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 19
   [junit4]   2> 620405 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@1abe912b[collection1] main
   [junit4]   2> 620405 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620406 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620407 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_j,generation=19}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_k,generation=20}
   [junit4]   2> 620407 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1abe912b[collection1] main{StandardDirectoryReader(segments_j:109:nrt _n(4.7):c1 _q(4.7):c1 _w(4.7):c1)}
   [junit4]   2> 620407 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 20
   [junit4]   2> 620409 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@e185c2f1[collection1] main
   [junit4]   2> 620410 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620410 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620411 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e185c2f1[collection1] main{StandardDirectoryReader(segments_j:109:nrt _n(4.7):c1 _q(4.7):c1 _w(4.7):c1)}
   [junit4]   2> 620412 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_k,generation=20}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_l,generation=21}
   [junit4]   2> 620412 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 21
   [junit4]   2> 620414 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@c93383ef[collection1] main
   [junit4]   2> 620415 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620415 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620416 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c93383ef[collection1] main{StandardDirectoryReader(segments_l:114:nrt _n(4.7):c1 _w(4.7):c1 _x(4.7):c1)}
   [junit4]   2> 620417 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_l,generation=21}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_m,generation=22}
   [junit4]   2> 620418 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 22
   [junit4]   2> 620419 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@53e095df[collection1] main
   [junit4]   2> 620419 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620420 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620421 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53e095df[collection1] main{StandardDirectoryReader(segments_m:117:nrt _w(4.7):c1 _y(4.7):c1)}
   [junit4]   2> 620422 T1923 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_m,generation=22}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_n,generation=23}
   [junit4]   2> 620423 T1923 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 23
   [junit4]   2> 620424 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@54d7ca41[collection1] main
   [junit4]   2> 620424 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620425 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620426 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54d7ca41[collection1] main{StandardDirectoryReader(segments_n:121:nrt _w(4.7):c1 _z(4.7):c1)}
   [junit4]   2> 620427 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_n,generation=23}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_o,generation=24}
   [junit4]   2> 620428 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 24
   [junit4]   2> 620428 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@289fa7ae[collection1] main
   [junit4]   2> 620429 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620429 T1924 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620431 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@289fa7ae[collection1] main{StandardDirectoryReader(segments_o:125:nrt _z(4.7):c1 _10(4.7):c1)}
   [junit4]   2> 620431 T1924 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_o,generation=24}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_p,generation=25}
   [junit4]   2> 620432 T1924 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 25
   [junit4]   2> 620432 T1924 oass.SolrIndexSearcher.<init> Opening Searcher@66281c42[collection1] main
   [junit4]   2> 620433 T1924 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620433 T1923 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620434 T1923 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620435 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66281c42[collection1] main{StandardDirectoryReader(segments_p:129:nrt _11(4.7):c1)}
   [junit4]   2> 620437 T1923 oass.SolrIndexSearcher.<init> Opening Searcher@4e40b079[collection1] main
   [junit4]   2> 620438 T1923 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620439 T1922 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620439 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e40b079[collection1] main{StandardDirectoryReader(segments_p:133:nrt _12(4.7):c1)}
   [junit4]   2> 620439 T1922 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_p,generation=25}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_q,generation=26}
   [junit4]   2> 620440 T1922 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 26
   [junit4]   2> 620440 T1922 oass.SolrIndexSearcher.<init> Opening Searcher@11d8a25d[collection1] main
   [junit4]   2> 620441 T1922 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620441 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11d8a25d[collection1] main{StandardDirectoryReader(segments_p:133:nrt _12(4.7):c1)}
   [junit4]   2> ASYNC  NEW_CORE C1114 name=collection1 org.apache.solr.core.SolrCore@c41398f6
   [junit4]   2> 620442 T1911 C1114 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620442 T1911 C1114 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 620443 T1911 C1114 oass.SolrIndexSearcher.<init> Opening Searcher@ef7b8596[collection1] main
   [junit4]   2> 620444 T1911 C1114 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620444 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ef7b8596[collection1] main{StandardDirectoryReader(segments_p:133:nrt _12(4.7):c1)}
   [junit4]   2> 620445 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 3
   [junit4]   2> 620446 T1911 oas.SolrTestCaseJ4.tearDown ###Ending testMultiThreaded
   [junit4]   2> 620450 T1911 oas.SolrTestCaseJ4.setUp ###Starting testNonStringFieldsValues
   [junit4]   2> 620450 T1911 C1114 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 620451 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 620452 T1911 C1114 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620453 T1911 C1114 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_q,generation=26}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_r,generation=27}
   [junit4]   2> 620453 T1911 C1114 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 27
   [junit4]   2> 620454 T1911 C1114 oass.SolrIndexSearcher.<init> Opening Searcher@e2e1602[collection1] main
   [junit4]   2> 620455 T1911 C1114 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620456 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e2e1602[collection1] main{StandardDirectoryReader(segments_r:134:nrt)}
   [junit4]   2> 620457 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 5
   [junit4]   2> 620462 T1911 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 620466 T1911 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620468 T1911 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_r,generation=27}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_s,generation=28}
   [junit4]   2> 620468 T1911 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 28
   [junit4]   2> 620469 T1911 oass.SolrIndexSearcher.<init> Opening Searcher@d82b9cfc[collection1] main
   [junit4]   2> 620470 T1911 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620471 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d82b9cfc[collection1] main{StandardDirectoryReader(segments_s:136:nrt _13(4.7):c5/1:delGen=1)}
   [junit4]   2> 620472 T1911 oas.SolrTestCaseJ4.tearDown ###Ending testNonStringFieldsValues
   [junit4]   2> 620475 T1911 oas.SolrTestCaseJ4.setUp ###Starting testDupeDetection
   [junit4]   2> 620476 T1911 C1114 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 620476 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 0
   [junit4]   2> 620477 T1911 C1114 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620478 T1911 C1114 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_s,generation=28}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_t,generation=29}
   [junit4]   2> 620479 T1911 C1114 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 29
   [junit4]   2> 620479 T1911 C1114 oass.SolrIndexSearcher.<init> Opening Searcher@40fd14aa[collection1] main
   [junit4]   2> 620480 T1911 C1114 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620481 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40fd14aa[collection1] main{StandardDirectoryReader(segments_t:137:nrt)}
   [junit4]   2> 620481 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 620486 T1911 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620487 T1911 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_t,generation=29}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_u,generation=30}
   [junit4]   2> 620488 T1911 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 30
   [junit4]   2> 620488 T1911 oass.SolrIndexSearcher.<init> Opening Searcher@6553f3cd[collection1] main
   [junit4]   2> 620489 T1911 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620490 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6553f3cd[collection1] main{StandardDirectoryReader(segments_u:139:nrt _14(4.7):c2)}
   [junit4]   2> 620493 T1911 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620495 T1911 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_u,generation=30}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_v,generation=31}
   [junit4]   2> 620496 T1911 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 31
   [junit4]   2> 620496 T1911 oass.SolrIndexSearcher.<init> Opening Searcher@a66c752[collection1] main
   [junit4]   2> 620497 T1911 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620498 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a66c752[collection1] main{StandardDirectoryReader(segments_v:142:nrt _14(4.7):c2/1:delGen=1 _15(4.7):c1)}
   [junit4]   2> 620499 T1911 oas.SolrTestCaseJ4.tearDown ###Ending testDupeDetection
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SignatureUpdateProcessorFactoryTest -Dtests.method=testDupeDetection -Dtests.seed=406CCC1BF787BBDA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fi_FI -Dtests.timezone=America/Cuiaba -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.03s J1 | SignatureUpdateProcessorFactoryTest.testDupeDetection <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but was:<2>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([406CCC1BF787BBDA:1B5C37D3F4C018A6]:0)
   [junit4]    > 	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.checkNumDocs(SignatureUpdateProcessorFactoryTest.java:71)
   [junit4]    > 	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.testDupeDetection(SignatureUpdateProcessorFactoryTest.java:119)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:780)
   [junit4]   2> 620507 T1911 oas.SolrTestCaseJ4.setUp ###Starting testNonIndexedSignatureField
   [junit4]   2> 620507 T1911 C1114 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 620508 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 620509 T1911 C1114 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620510 T1911 C1114 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_v,generation=31}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_w,generation=32}
   [junit4]   2> 620510 T1911 C1114 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 32
   [junit4]   2> 620511 T1911 C1114 oass.SolrIndexSearcher.<init> Opening Searcher@b1dc36a6[collection1] main
   [junit4]   2> 620511 T1911 C1114 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620513 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b1dc36a6[collection1] main{StandardDirectoryReader(segments_w:143:nrt)}
   [junit4]   2> 620513 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 620517 T1911 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620519 T1911 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_w,generation=32}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_x,generation=33}
   [junit4]   2> 620519 T1911 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 33
   [junit4]   2> 620520 T1911 oass.SolrIndexSearcher.<init> Opening Searcher@65c566a0[collection1] main
   [junit4]   2> 620521 T1911 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620522 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65c566a0[collection1] main{StandardDirectoryReader(segments_x:145:nrt _16(4.7):c2)}
   [junit4]   2> 620522 T1911 oas.SolrTestCaseJ4.tearDown ###Ending testNonIndexedSignatureField
   [junit4]   2> 620526 T1911 oas.SolrTestCaseJ4.setUp ###Starting testFailNonIndexedSigWithOverwriteDupes
   [junit4]   2> 620527 T1911 C1114 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 620527 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 0
   [junit4]   2> 620529 T1911 C1114 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620529 T1911 C1114 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_x,generation=33}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_y,generation=34}
   [junit4]   2> 620530 T1911 C1114 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 34
   [junit4]   2> 620530 T1911 C1114 oass.SolrIndexSearcher.<init> Opening Searcher@5591fa73[collection1] main
   [junit4]   2> 620531 T1911 C1114 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620532 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5591fa73[collection1] main{StandardDirectoryReader(segments_y:146:nrt)}
   [junit4]   2> 620533 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 620534 T1911 oas.SolrTestCaseJ4.tearDown ###Ending testFailNonIndexedSigWithOverwriteDupes
   [junit4]   2> 620538 T1911 oas.SolrTestCaseJ4.setUp ###Starting testDupeAllFieldsDetection
   [junit4]   2> 620538 T1911 C1114 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 620539 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 620540 T1911 C1114 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620541 T1911 C1114 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_y,generation=34}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_z,generation=35}
   [junit4]   2> 620542 T1911 C1114 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 35
   [junit4]   2> 620542 T1911 C1114 oass.SolrIndexSearcher.<init> Opening Searcher@c26beb32[collection1] main
   [junit4]   2> 620543 T1911 C1114 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620544 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c26beb32[collection1] main{StandardDirectoryReader(segments_z:147:nrt)}
   [junit4]   2> 620544 T1911 C1114 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 4
   [junit4]   2> 620550 T1911 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 620551 T1911 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_z,generation=35}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@4d4deeda lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb91c9c2)),segFN=segments_10,generation=36}
   [junit4]   2> 620552 T1911 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 36
   [junit4]   2> 620553 T1911 oass.SolrIndexSearcher.<init> Opening Searcher@2a831485[collection1] main
   [junit4]   2> 620553 T1911 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 620555 T1913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a831485[collection1] main{StandardDirectoryReader(segments_10:149:nrt _17(4.7):c3)}
   [junit4]   2> 620555 T1911 oas.SolrTestCaseJ4.tearDown ###Ending testDupeAllFieldsDetection
   [junit4]   2> 620557 T1911 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 620557 T1911 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=18798139
   [junit4]   2> 620557 T1911 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@c41398f6
   [junit4]   2> 620565 T1911 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=42,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=253,cumulative_deletesById=0,cumulative_deletesByQuery=6,cumulative_errors=0}
   [junit4]   2> 620565 T1911 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 620566 T1911 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 620566 T1911 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 620566 T1911 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 620567 T1911 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 620567 T1911 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368;done=false>>]
   [junit4]   2> 620567 T1911 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368
   [junit4]   2> 620568 T1911 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/index;done=false>>]
   [junit4]   2> 620568 T1911 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392580270368/index
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=fi_FI, timezone=America/Cuiaba
   [junit4]   2> NOTE: Linux 3.8.0-35-generic amd64/IBM Corporation 1.7.0 (64-bit)/cpus=8,threads=1,free=83417208,total=236847104
   [junit4]   2> NOTE: All tests run in this JVM: [TestWordDelimiterFilterFactory, TestRTGBase, DateFieldTest, StandardRequestHandlerTest, TestHashPartitioner, RequestHandlersTest, BJQParserTest, TestCSVLoader, TestRangeQuery, TestLazyCores, TestBlendedInfixSuggestions, TestFuzzyAnalyzedSuggestions, TestClassNameShortening, BadIndexSchemaTest, TestFiltering, CursorMarkTest, NoCacheHeaderTest, DisMaxRequestHandlerTest, SolrCmdDistributorTest, TestMultiCoreConfBootstrap, UniqFieldsUpdateProcessorFactoryTest, TestFieldTypeResource, HighlighterTest, TestDFRSimilarityFactory, TestManagedSchema, TestReload, NumericFieldsTest, SpellingQueryConverterTest, PrimUtilsTest, TestIBSimilarityFactory, TestBinaryField, TestAnalyzedSuggestions, SuggestComponentTest, IndexSchemaRuntimeFieldTest, ChaosMonkeyNothingIsSafeTest, TestSolrJ, CurrencyFieldOpenExchangeTest, BasicDistributedZk2Test, TestNRTOpen, TestDynamicFieldResource, TestSolrCoreProperties, OpenCloseCoreStressTest, TestSolr4Spatial, StatsComponentTest, TestFreeTextSuggestions, AddBlockUpdateTest, ConvertedLegacyTest, XmlUpdateRequestHandlerTest, TestJmxIntegration, TestUpdate, SuggesterTSTTest, TestSimpleQParserPlugin, TestHighlightDedupGrouping, TestFastLRUCache, TestStressReorder, DefaultValueUpdateProcessorTest, RAMDirectoryFactoryTest, TestQuerySenderNoQuery, LeaderElectionIntegrationTest, TestComponentsName, TestRecovery, TestCoreDiscovery, CurrencyFieldXmlFileTest, TestCopyFieldCollectionResource, DeleteReplicaTest, RequiredFieldsTest, CursorPagingTest, SpellCheckCollatorTest, SolrCoreCheckLockOnStartupTest, HardAutoCommitTest, SuggesterWFSTTest, TestFastOutputStream, AssignTest, TestDistributedGrouping, TestFileDictionaryLookup, TestNonDefinedSimilarityFactory, TestCloudManagedSchema, TestPartialUpdateDeduplication, TestPhraseSuggestions, SolrRequestParserTest, IndexBasedSpellCheckerTest, RemoteQueryErrorTest, TestNumberUtils, FullSolrCloudDistribCmdsTest, FieldAnalysisRequestHandlerTest, TestIndexSearcher, TestDocBasedVersionConstraints, TestXIncludeConfig, TestRandomFaceting, ZkCLITest, DistributedTermsComponentTest, TestCoreContainer, SolrCoreTest, SpellCheckComponentTest, DirectUpdateHandlerTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SimplePostToolTest, SignatureUpdateProcessorFactoryTest]
   [junit4] Completed on J1 in 1.53s, 6 tests, 1 failure <<< FAILURES!

[...truncated 459 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:452: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 362 suites, 1563 tests, 1 failure, 71 ignored (7 assumptions)

Total time: 41 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.6.0_45) - Build # 9390 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9390/
Java: 32bit/jdk1.6.0_45 -client -XX:+UseConcMarkSweepGC

5 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1

Stack Trace:
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at __randomizedtesting.SeedInfo.seed([6EBAA2A5A27E99F5:6AB22D56B0DB76D4]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:429)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:426)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:153)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:584)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.TestDistributedGrouping.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /_nj/y/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /_nj/y/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([6EBAA2A5A27E99F5:EF5C2CBDD521F9C9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedGrouping.doTest(TestDistributedGrouping.java:156)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /u_ag/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /u_ag/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([6EBAA2A5A27E99F5:EF5C2CBDD521F9C9]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:177)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:51737/_b/ta/collection1, https://127.0.0.1:60034/_b/ta/collection1, https://127.0.0.1:52913/_b/ta/collection1, https://127.0.0.1:43069/_b/ta/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:51737/_b/ta/collection1, https://127.0.0.1:60034/_b/ta/collection1, https://127.0.0.1:52913/_b/ta/collection1, https://127.0.0.1:43069/_b/ta/collection1]
	at __randomizedtesting.SeedInfo.seed([6EBAA2A5A27E99F5:EF5C2CBDD521F9C9]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkQueries(AbstractFullDistribZkTestBase.java:797)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:101)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /_b/ta/collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 50 more


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:38051/collection1, http://127.0.0.1:40212/collection1, http://127.0.0.1:58497/collection1, http://127.0.0.1:33914/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38051/collection1, http://127.0.0.1:40212/collection1, http://127.0.0.1:58497/collection1, http://127.0.0.1:33914/collection1]
	at __randomizedtesting.SeedInfo.seed([6EBAA2A5A27E99F5:EF5C2CBDD521F9C9]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.BasicDistributedZkTest.queryServer(BasicDistributedZkTest.java:1176)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:264)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 48 more




Build Log:
[...truncated 9244 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedGrouping
   [junit4]   2> 5295 T15 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 5296 T15 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_nj/y
   [junit4]   2> 5299 T15 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 5407 T15 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 5485 T15 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58125
   [junit4]   2> 5508 T15 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 5509 T15 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 5509 T15 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 5510 T15 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 5523 T15 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/solr.xml
   [junit4]   2> 5574 T15 oasc.CoreContainer.<init> New CoreContainer 26209871
   [junit4]   2> 5575 T15 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 5585 T15 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 5585 T15 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 5586 T15 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 5586 T15 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 5587 T15 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 5587 T15 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 5588 T15 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 5588 T15 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 5589 T15 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 5592 T15 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 5592 T15 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 5593 T15 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 5598 T27 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 5600 T27 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 5602 T27 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 5602 T27 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 5661 T27 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 5731 T27 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 5732 T27 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 5743 T27 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 6253 T27 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 6253 T27 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 6254 T27 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 6261 T27 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 6264 T27 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 6275 T27 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 6278 T27 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 6281 T27 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 6281 T27 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 6282 T27 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 6282 T27 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 6282 T27 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 6282 T27 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 6283 T27 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 6283 T27 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedGrouping-1392573142499/control/data/
   [junit4]   2> 6284 T27 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 6284 T27 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392573142499/control/data
   [junit4]   2> 6285 T27 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedGrouping-1392573142499/control/data/index/
   [junit4]   2> 6285 T27 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedGrouping-1392573142499/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 6285 T27 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392573142499/control/data/index
   [junit4]   2> 6286 T27 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.858552095166186]
   [junit4]   2> 6286 T27 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@8edd79 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a27a8f)),segFN=segments_1,generation=1}
   [junit4]   2> 6287 T27 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6287 T27 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 6288 T27 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 6289 T27 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 6289 T27 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 6290 T27 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 6290 T27 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 6290 T27 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 6290 T27 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 6291 T27 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 6291 T27 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 6291 T27 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 6292 T27 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 6292 T27 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 6292 T27 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 6293 T27 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 6293 T27 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 6293 T27 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 6294 T27 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 6294 T27 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 6294 T27 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 6295 T27 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 6295 T27 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 6295 T27 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 6296 T27 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 6296 T27 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 6296 T27 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 6296 T27 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 6297 T27 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6297 T27 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6297 T27 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6298 T27 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6298 T27 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6298 T27 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6299 T27 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6299 T27 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 6299 T27 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 6300 T27 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 6301 T27 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6303 T27 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 6306 T27 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 6306 T27 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 6306 T27 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=52.294921875, floorSegmentMB=1.294921875, forceMergeDeletesPctAllowed=26.706520987618294, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26883930565034775
   [junit4]   2> 6309 T27 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@8edd79 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a27a8f)),segFN=segments_1,generation=1}
   [junit4]   2> 6309 T27 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6309 T27 oass.SolrIndexSearcher.<init> Opening Searcher@bdff3b[collection1] main
   [junit4]   2> 6310 T27 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 6366 T27 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 6396 T28 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bdff3b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 6396 T27 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 6397 T15 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 6397 T15 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 6411 T15 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 6415 T15 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49886
   [junit4]   2> 6417 T15 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 6417 T15 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6418 T15 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 6419 T15 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 6438 T15 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/solr.xml
   [junit4]   2> 6484 T15 oasc.CoreContainer.<init> New CoreContainer 8053093
   [junit4]   2> 6485 T15 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 6486 T15 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 6486 T15 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 6486 T15 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 6487 T15 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 6487 T15 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 6488 T15 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 6488 T15 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 6488 T15 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 6489 T15 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 6492 T15 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 6492 T15 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 6492 T15 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 6497 T39 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 6497 T39 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 6499 T39 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 6499 T39 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 6570 T39 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 6639 T39 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 6640 T39 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 6649 T39 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 7105 T39 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 7105 T39 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 7106 T39 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 7113 T39 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 7116 T39 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 7127 T39 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 7132 T39 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 7139 T39 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 7140 T39 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 7140 T39 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 7141 T39 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 7142 T39 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 7143 T39 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 7143 T39 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 7144 T39 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedGrouping-1392573142499/shard0/data/
   [junit4]   2> 7145 T39 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 7147 T39 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392573142499/shard0/data
   [junit4]   2> 7147 T39 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedGrouping-1392573142499/shard0/data/index/
   [junit4]   2> 7148 T39 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedGrouping-1392573142499/shard0/data/index' doesn't exist. Creating new index...
   [junit4]   2> 7149 T39 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392573142499/shard0/data/index
   [junit4]   2> 7149 T39 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.858552095166186]
   [junit4]   2> 7151 T39 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6be4cc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ed5ba6)),segFN=segments_1,generation=1}
   [junit4]   2> 7152 T39 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 7152 T39 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 7153 T39 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 7154 T39 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 7154 T39 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 7154 T39 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 7155 T39 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 7155 T39 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 7155 T39 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 7156 T39 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 7156 T39 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 7157 T39 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 7157 T39 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 7157 T39 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 7158 T39 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 7158 T39 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 7158 T39 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 7159 T39 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 7159 T39 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 7159 T39 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 7160 T39 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 7160 T39 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 7160 T39 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 7161 T39 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 7161 T39 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 7161 T39 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 7161 T39 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 7162 T39 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 7162 T39 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7162 T39 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7163 T39 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7163 T39 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7163 T39 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7163 T39 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7164 T39 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7164 T39 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 7164 T39 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 7165 T39 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 7167 T39 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 7168 T39 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 7171 T39 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 7172 T39 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 7173 T39 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=52.294921875, floorSegmentMB=1.294921875, forceMergeDeletesPctAllowed=26.706520987618294, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.26883930565034775
   [junit4]   2> 7174 T39 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@6be4cc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ed5ba6)),segFN=segments_1,generation=1}
   [junit4]   2> 7175 T39 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 7175 T39 oass.SolrIndexSearcher.<init> Opening Searcher@15f0876[collection1] main
   [junit4]   2> 7176 T39 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 7182 T39 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 7208 T40 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15f0876[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 7208 T39 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 7210 T15 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 7211 T15 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C2 name=collection1 org.apache.solr.core.SolrCore@ab4b89
   [junit4]   2> 12507 T24 C2 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1460218782986272768)} 0 47
   [junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@d448a1
   [junit4]   2> 12564 T38 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1460218783083790336)} 0 3
   [junit4]   2> 12573 T25 C2 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 12574 T25 C2 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 12575 T25 C2 oass.SolrIndexSearcher.<init> Opening Searcher@114a41[collection1] main
   [junit4]   2> 12576 T28 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@114a41[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 12577 T25 C2 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 12577 T25 C2 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
   [junit4]   2> 12582 T35 C3 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 12583 T35 C3 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 12585 T35 C3 oass.SolrIndexSearcher.<init> Opening Searcher@166b0df[collection1] main
   [junit4]   2> 12589 T40 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@166b0df[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 12590 T35 C3 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 12591 T35 C3 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
   [junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@ab4b89
   [junit4]   2> 12668 T26 C4 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&fl=id,a_si&q=*:*&group.limit=10&distrib=false&group.field=a_si&group=true&wt=javabin&version=2&rows=100} hits=0 status=0 QTime=66 
   [junit4]   2> ASYNC  NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@d448a1
   [junit4]   2> 12705 T36 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&group.distributed.first=true&group.limit=10&distrib=false&wt=javabin&version=2&rows=100&fl=id&shard.url=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y|[ff01::083]:33332/_nj/y|[ff01::213]:33332/_nj/y&NOW=1392573149874&start=0&q=*:*&group.field=a_si&group=true&isShard=true} status=0 QTime=16 
   [junit4]   2> 12723 T37 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={shards=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y|[ff01::083]:33332/_nj/y|[ff01::213]:33332/_nj/y&sort=a_si+asc,+id+asc&fl=id,a_si&q=*:*&group.limit=10&group.field=a_si&group=true&wt=javabin&version=2&rows=100} status=0 QTime=49 
   [junit4]   2> 12748 T24 C4 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&fl=id,a_si&q=*:*&group.limit=10&distrib=false&group.field=a_si&hl.fl=a_t&group=true&wt=javabin&hl=true&version=2&rows=100} hits=0 status=0 QTime=20 
   [junit4]   2> 18110 T36 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&group.distributed.first=true&group.limit=10&distrib=false&hl.fl=a_t&wt=javabin&hl=false&version=2&rows=100&NOW=1392573149951&shard.url=http://127.0.0.1:49886/_nj/y|[ff01::213]:33332/_nj/y|[ff01::083]:33332/_nj/y&fl=id&start=0&q=*:*&group.field=a_si&group=true&isShard=true} status=0 QTime=0 
   [junit4]   2> 18114 T38 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={shards=http://127.0.0.1:49886/_nj/y|[ff01::213]:33332/_nj/y|[ff01::083]:33332/_nj/y&sort=a_si+asc,+id+asc&fl=id,a_si&q=*:*&group.limit=10&group.field=a_si&hl.fl=a_t&group=true&wt=javabin&hl=true&version=2&rows=100} status=0 QTime=5363 
   [junit4]   2> 18157 T24 C4 oasr.UnInvertedField.<init> UnInverted multi-valued field {field=a_t,memSize=4288,tindexSize=0,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
   [junit4]   2> 18159 T24 C4 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=true&sort=a_si+asc,+id+asc&fl=id,a_si&q=*:*&group.limit=10&distrib=false&group.field=a_si&facet.field=a_t&group=true&wt=javabin&version=2&rows=100} hits=0 status=0 QTime=40 
   [junit4]   2> 18170 T36 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=false&sort=a_si+asc,+id+asc&group.distributed.first=true&group.limit=10&distrib=false&wt=javabin&version=2&rows=100&NOW=1392573155366&shard.url=http://127.0.0.1:49886/_nj/y|[ff01::114]:33332/_nj/y|[ff01::083]:33332/_nj/y|[ff01::213]:33332/_nj/y&fl=id&start=0&q=*:*&group.field=a_si&facet.field=a_t&group=true&isShard=true} status=0 QTime=0 
   [junit4]   2> 18187 T38 C5 oasr.UnInvertedField.<init> UnInverted multi-valued field {field=a_t,memSize=4288,tindexSize=0,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
   [junit4]   2> 18188 T38 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=true&sort=a_si+asc,+id+asc&group.limit=10&distrib=false&wt=javabin&group.distributed.second=true&version=2&rows=100&f.a_t.facet.limit=160&NOW=1392573155366&shard.url=http://127.0.0.1:49886/_nj/y|[ff01::114]:33332/_nj/y|[ff01::083]:33332/_nj/y|[ff01::213]:33332/_nj/y&fl=id&start=0&q=*:*&group.field=a_si&facet.field=a_t&group=true&isShard=true} status=0 QTime=8 
   [junit4]   2> 18197 T35 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=true&shards=http://127.0.0.1:49886/_nj/y|[ff01::114]:33332/_nj/y|[ff01::083]:33332/_nj/y|[ff01::213]:33332/_nj/y&sort=a_si+asc,+id+asc&fl=id,a_si&q=*:*&group.limit=10&group.field=a_si&facet.field=a_t&group=true&wt=javabin&version=2&rows=100} status=0 QTime=31 
   [junit4]   2> 18213 T25 C4 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&fl=id,a_si&stats.field=a_si&stats=true&q=*:*&group.limit=10&distrib=false&group.field=a_si&group=true&wt=javabin&version=2&rows=100} hits=0 status=0 QTime=11 
   [junit4]   2> 18220 T36 C5 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&group.distributed.first=true&stats=false&group.limit=10&distrib=false&wt=javabin&version=2&rows=100&NOW=1392573155416&shard.url=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y&fl=id&start=0&stats.field=a_si&q=*:*&group.field=a_si&group=true&isShard=true} status=0 QTime=1 
   [junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@d448a1
   [junit4]   2> 18231 T38 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={sort=a_si+asc,+id+asc&stats=true&group.limit=10&distrib=false&wt=javabin&group.distributed.second=true&version=2&rows=100&NOW=1392573155416&shard.url=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y&fl=id&start=0&stats.field=a_si&q=*:*&group.field=a_si&group=true&isShard=true} status=0 QTime=0 
   [junit4]   2> 18233 T37 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={shards=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y&sort=a_si+asc,+id+asc&fl=id,a_si&stats.field=a_si&stats=true&q=*:*&group.limit=10&group.field=a_si&group=true&wt=javabin&version=2&rows=100} status=0 QTime=17 
   [junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@ab4b89
   [junit4]   2> 18274 T26 C7 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={spellcheck=true&sort=a_si+asc,+id+asc&group.limit=10&distrib=false&wt=javabin&rows=100&version=2&fl=id,a_si&q=kings&group.field=a_si&group=true&qt=spellCheckCompRH&spellcheck.build=true} hits=0 status=0 QTime=36 
   [junit4]   2> 18313 T36 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={spellcheck=true&group.distributed.first=true&sort=a_si+asc,+id+asc&spellcheck.extendedResults=false&group.limit=10&distrib=false&wt=javabin&version=2&spellcheck.onlyMorePopular=false&rows=100&NOW=1392573155481&shard.url=http://127.0.0.1:49886/_nj/y|[ff01::213]:33332/_nj/y&fl=id&start=0&q=kings&group.field=a_si&spellcheck.count=5&group=true&isShard=true&spellcheck.build=true} status=0 QTime=2 
   [junit4]   2> 18316 T35 C6 oashc.SpellCheckComponent.finishStage http://127.0.0.1:49886/_nj/y|[ff01::213]:33332/_nj/y null
   [junit4]   2> 18317 T35 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={spellcheck=true&sort=a_si+asc,+id+asc&group.limit=10&wt=javabin&rows=100&version=2&fl=id,a_si&shards=http://127.0.0.1:49886/_nj/y|[ff01::213]:33332/_nj/y&q=kings&group.field=a_si&group=true&qt=spellCheckCompRH&spellcheck.build=true} status=0 QTime=36 
   [junit4]   2> 18343 T24 C7 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=true&sort=a_si+asc,+id+asc&group.limit=10&distrib=false&wt=javabin&version=2&rows=100&fl=id,a_si&q=*:*&group.truncate=true&group.field=a_si&group=true&facet.field=a_t&fq=a_s:a} hits=0 status=0 QTime=21 
   [junit4]   2> 18366 T37 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=false&sort=a_si+asc,+id+asc&group.distributed.first=true&group.limit=10&distrib=false&wt=javabin&version=2&rows=100&NOW=1392573155548&shard.url=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y&fl=id&start=0&q=*:*&group.truncate=true&group.field=a_si&group=true&facet.field=a_t&isShard=true&fq=a_s:a} status=0 QTime=1 
   [junit4]   2> 18385 T35 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=true&sort=a_si+asc,+id+asc&group.limit=10&distrib=false&wt=javabin&group.distributed.second=true&version=2&f.a_t.facet.limit=160&rows=100&NOW=1392573155548&shard.url=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y&fl=id&start=0&q=*:*&group.truncate=true&group.field=a_si&group=true&facet.field=a_t&isShard=true&fq=a_s:a} status=0 QTime=14 
   [junit4]   2> 18386 T38 C6 oasc.SolrCore.execute [collection1] webapp=/_nj/y path=/select params={facet=true&sort=a_si+asc,+id+asc&group.limit=10&wt=javabin&version=2&rows=100&fl=id,a_si&shards=[ff01::114]:33332/_nj/y|http://127.0.0.1:49886/_nj/y&q=*:*&group.truncate=true&group.field=a_si&group=true&facet.field=a_t&fq=a_s:a} status=0 QTime=38 
   [junit4]   2> 18406 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[1 (1460218789200134144)]} 0 13
   [junit4]   2> 18419 T36 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[1 (1460218789219008512)]} 0 9
   [junit4]   2> 18434 T23 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[2 (1460218789233688576)]} 0 10
   [junit4]   2> 18446 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[2 (1460218789247320064)]} 0 8
   [junit4]   2> 18457 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[3 (1460218789262000128)]} 0 5
   [junit4]   2> 18468 T35 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[3 (1460218789271437312)]} 0 7
   [junit4]   2> 18479 T26 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[4 (1460218789282971648)]} 0 7
   [junit4]   2> 18489 T38 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[4 (1460218789294505984)]} 0 6
   [junit4]   2> 18499 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[5 (1460218789304991744)]} 0 6
   [junit4]   2> 18509 T36 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[5 (1460218789315477504)]} 0 6
   [junit4]   2> 18519 T23 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[6 (1460218789327011840)]} 0 5
   [junit4]   2> 18529 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[6 (1460218789337497600)]} 0 5
   [junit4]   2> 18538 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[7 (1460218789346934784)]} 0 5
   [junit4]   2> 18546 T38 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[7 (1460218789356371968)]} 0 4
   [junit4]   2> 18555 T26 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[8 (1460218789365809152)]} 0 4
   [junit4]   2> 18564 T36 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[8 (1460218789375246336)]} 0 4
   [junit4]   2> 18572 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[9 (1460218789384683520)]} 0 3
   [junit4]   2> 18579 T35 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[9 (1460218789390974976)]} 0 3
   [junit4]   2> 18586 T23 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[10 (1460218789399363584)]} 0 3
   [junit4]   2> 18592 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[10 (1460218789405655040)]} 0 3
   [junit4]   2> 18600 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[11 (1460218789412995072)]} 0 4
   [junit4]   2> 18608 T38 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[11 (1460218789421383680)]} 0 4
   [junit4]   2> 18615 T26 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[12 (1460218789428723712)]} 0 3
   [junit4]   2> 18623 T36 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[12 (1460218789437112320)]} 0 4
   [junit4]   2> 18630 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[14 (1460218789444452352)]} 0 3
   [junit4]   2> 18635 T35 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[14 (1460218789450743808)]} 0 2
   [junit4]   2> 18643 T23 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[15 (1460218789459132416)]} 0 3
   [junit4]   2> 18650 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[15 (1460218789465423872)]} 0 3
   [junit4]   2> 18657 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[16 (1460218789473812480)]} 0 2
   [junit4]   2> 18664 T38 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[16 (1460218789481152512)]} 0 3
   [junit4]   2> 18678 T26 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[17 (1460218789491638272)]} 0 9
   [junit4]   2> 18692 T36 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[17 (1460218789505269760)]} 0 9
   [junit4]   2> 18700 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[18 (1460218789517852672)]} 0 4
   [junit4]   2> 18707 T35 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[18 (1460218789525192704)]} 0 3
   [junit4]   2> 18713 T23 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[19 (1460218789532532736)]} 0 2
   [junit4]   2> 18717 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[19 (1460218789537775616)]} 0 2
   [junit4]   2> 18722 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[20 (1460218789543018496)]} 0 1
   [junit4]   2> 18727 T38 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[20 (1460218789547212800)]} 0 2
   [junit4]   2> 18733 T26 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[21 (1460218789552455680)]} 0 3
   [junit4]   2> 18739 T36 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[21 (1460218789559795712)]} 0 2
   [junit4]   2> 18746 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[22 (1460218789567135744)]} 0 2
   [junit4]   2> 18753 T35 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[22 (1460218789574475776)]} 0 3
   [junit4]   2> 18760 T23 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[23 (1460218789580767232)]} 0 3
   [junit4]   2> 18766 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[23 (1460218789588107264)]} 0 2
   [junit4]   2> 18773 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[100 (1460218789595447296)]} 0 3
   [junit4]   2> 18780 T38 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[100 (1460218789602787328)]} 0 3
   [junit4]   2> 18786 T26 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[101 (1460218789609078784)]} 0 2
   [junit4]   2> 18792 T35 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[101 (1460218789615370240)]} 0 2
   [junit4]   2> 18799 T25 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[102 (1460218789622710272)]} 0 2
   [junit4]   2> 18805 T37 C6 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[102 (1460218789629001728)]} 0 2
   [junit4]   2> 18812 T24 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[103 (1460218789636341760)]} 0 3
   [junit4]   2> ASYNC  NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@d448a1
   [junit4]   2> 18824 T38 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[103 (1460218789643681792)]} 0 8
   [junit4]   2> ASYNC  NEW_CORE C9 name=collection1 org.apache.solr.core.SolrCore@ab4b89
   [junit4]   2> 18831 T26 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[104 (1460218789656264704)]} 0 2
   [junit4]   2> 18837 T36 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[104 (1460218789662556160)]} 0 2
   [junit4]   2> 18844 T23 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[105 (1460218789668847616)]} 0 3
   [junit4]   2> 18850 T35 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[105 (1460218789676187648)]} 0 3
   [junit4]   2> 18856 T25 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[106 (1460218789682479104)]} 0 2
   [junit4]   2> 18862 T37 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[106 (1460218789688770560)]} 0 2
   [junit4]   2> 18868 T24 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[107 (1460218789695062016)]} 0 2
   [junit4]   2> 18874 T38 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[107 (1460218789702402048)]} 0 2
   [junit4]   2> 18881 T26 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[108 (1460218789708693504)]} 0 3
   [junit4]   2> 18887 T36 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[108 (1460218789716033536)]} 0 2
   [junit4]   2> 18894 T23 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[109 (1460218789722324992)]} 0 3
   [junit4]   2> 18900 T35 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[109 (1460218789728616448)]} 0 3
   [junit4]   2> 18906 T25 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[110 (1460218789734907904)]} 0 2
   [junit4]   2> 18912 T37 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[110 (1460218789741199360)]} 0 2
   [junit4]   2> 18918 T24 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[111 (1460218789747490816)]} 0 2
   [junit4]   2> 18924 T38 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[111 (1460218789753782272)]} 0 2
   [junit4]   2> 18930 T26 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[112 (1460218789760073728)]} 0 2
   [junit4]   2> 18936 T35 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[112 (1460218789766365184)]} 0 2
   [junit4]   2> 18942 T23 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[113 (1460218789772656640)]} 0 2
   [junit4]   2> 18949 T37 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[113 (1460218789778948096)]} 0 3
   [junit4]   2> 18955 T25 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[114 (1460218789786288128)]} 0 2
   [junit4]   2> 18961 T38 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[114 (1460218789792579584)]} 0 2
   [junit4]   2> 18967 T24 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[115 (1460218789798871040)]} 0 2
   [junit4]   2> 18973 T36 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[115 (1460218789806211072)]} 0 2
   [junit4]   2> 18980 T26 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[116 (1460218789812502528)]} 0 3
   [junit4]   2> 18986 T35 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[116 (1460218789818793984)]} 0 3
   [junit4]   2> 18992 T23 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[117 (1460218789825085440)]} 0 2
   [junit4]   2> 18997 T37 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[117 (1460218789831376896)]} 0 2
   [junit4]   2> 19003 T25 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[118 (1460218789837668352)]} 0 2
   [junit4]   2> 19009 T38 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[118 (1460218789842911232)]} 0 2
   [junit4]   2> 19015 T24 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[119 (1460218789850251264)]} 0 2
   [junit4]   2> 19022 T36 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[119 (1460218789856542720)]} 0 2
   [junit4]   2> 19028 T26 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[120 (1460218789862834176)]} 0 2
   [junit4]   2> 19034 T35 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[120 (1460218789869125632)]} 0 2
   [junit4]   2> 19040 T23 C9 oasup.LogUpdateProcessor.finish [collection1] webapp=/_nj/y path=/update params={wt=javabin&version=2} {add=[121 (1460218789875417088)]} 0 2
   [junit4]   2> 19046 T37 C8 oasup.LogUpdateProcessor.finish [collection1] webapp

[...truncated too long message...]

ingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty3/index;done=false>>]
   [junit4]   2> 851694 T3787 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty3/index
   [junit4]   2> 851694 T3787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 851694 T3787 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 851694 T3787 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 851695 T3787 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> ASYNC  NEW_CORE C4025 name=collection1 org.apache.solr.core.SolrCore@aff23e url=https://127.0.0.1:43069/_b/ta/collection1 node=127.0.0.1:43069__b%2Fta C4025_STATE=coll:collection1 core:collection1 props:{state=active, base_url=https://127.0.0.1:43069/_b/ta, core=collection1, node_name=127.0.0.1:43069__b%2Fta}
   [junit4]   2> 851784 T3806 C4025 P43069 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
   [junit4]   2> 851785 T3806 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
   [junit4]   2> 851786 T3806 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@aff23e
   [junit4]   2> 851795 T3806 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=35,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=1}
   [junit4]   2> 851796 T3806 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 851796 T3806 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 851796 T3806 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 851798 T3806 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 851798 T3806 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 851798 T3806 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty4;done=false>>]
   [junit4]   2> 851798 T3806 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty4
   [junit4]   2> 851799 T3806 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty4/index;done=false>>]
   [junit4]   2> 851799 T3806 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1392573960532/jetty4/index
   [junit4]   2> 851800 T3806 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 851800 T3806 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=mt, timezone=America/Goose_Bay
   [junit4]   2> NOTE: Linux 3.8.0-35-generic i386/Sun Microsystems Inc. 1.6.0_45 (32-bit)/cpus=8,threads=1,free=48164168,total=323203072
   [junit4]   2> NOTE: All tests run in this JVM: [CacheHeaderTest, TestDocumentBuilder, TriLevelCompositeIdRoutingTest, AutoCommitTest, SliceStateTest, TestLMJelinekMercerSimilarityFactory, URLClassifyProcessorTest, UUIDFieldTest, TestPHPSerializedResponseWriter, AnalysisErrorHandlingTest, BlockCacheTest, TestReversedWildcardFilterFactory, DocumentBuilderTest, JsonLoaderTest, TestJoin, TestBlendedInfixSuggestions, OverseerTest, ScriptEngineTest, SchemaVersionSpecificBehaviorTest, HdfsBasicDistributedZkTest, TestPostingsSolrHighlighter, BasicFunctionalityTest, TermVectorComponentTest, ResourceLoaderTest, SoftAutoCommitTest, TestPseudoReturnFields, EnumFieldTest, IndexSchemaTest, MigrateRouteKeyTest, OverseerCollectionProcessorTest, TestDocSet, QueryEqualityTest, TestElisionMultitermQuery, QueryParsingTest, RegexBoostProcessorTest, TestFieldCollectionResource, TestSolrDeletionPolicy1, InfoHandlerTest, SolrInfoMBeanTest, QueryElevationComponentTest, SOLR749Test, CopyFieldTest, TestReplicationHandler, SuggestComponentTest, DistributedSpellCheckComponentTest, AddSchemaFieldsUpdateProcessorFactoryTest, SearchHandlerTest, CSVRequestHandlerTest, TestRealTimeGet, TermsComponentTest, LeaderElectionTest, StatelessScriptUpdateProcessorFactoryTest, TestSort, TestJmxMonitoredMap, TestSchemaVersionResource, DeleteShardTest, MBeansHandlerTest, DeleteReplicaTest, ParsingFieldUpdateProcessorsTest, TestLFUCache, DateMathParserTest, TestQueryUtils, TestLMDirichletSimilarityFactory, BadComponentTest, TestValueSourceCache, TestSurroundQueryParser, HdfsChaosMonkeySafeLeaderTest, WordBreakSolrSpellCheckerTest, SuggesterTest, TestDynamicFieldResource, CustomCollectionTest, TestNoOpRegenerator, TestBadConfig, SystemInfoHandlerTest, UpdateRequestProcessorFactoryTest, CoreMergeIndexesAdminHandlerTest, ZkControllerTest, UnloadDistributedZkTest, TestStressVersions, TestGroupingSearch, ShowFileRequestHandlerTest, LegacyHTMLStripCharFilterTest, AnalysisAfterCoreReloadTest, PeerSyncTest, EchoParamsTest, MoreLikeThisHandlerTest, ClusterStateUpdateTest, TestSearchPerf, BasicDistributedZkTest, BasicDistributedZk2Test]
   [junit4] Completed on J0 in 28.72s, 1 test, 1 error <<< FAILURES!

[...truncated 576 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 362 suites, 1563 tests, 5 errors, 36 ignored (8 assumptions)

Total time: 59 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.6.0_45 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (64bit/ibm-j9-jdk6) - Build # 9389 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9389/
Java: 64bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}

1 tests failed.
REGRESSION:  org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.testDupeDetection

Error Message:
expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([2819D790A0731391:73292C58A334B0ED]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.checkNumDocs(SignatureUpdateProcessorFactoryTest.java:71)
	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.testDupeDetection(SignatureUpdateProcessorFactoryTest.java:119)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:60)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)
	at java.lang.reflect.Method.invoke(Method.java:611)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:738)




Build Log:
[...truncated 9373 lines...]
   [junit4] Suite: org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest
   [junit4]   2> 98038 T165 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 98040 T165 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994
   [junit4]   2> 98042 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 98044 T165 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 98045 T165 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 98116 T165 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 98220 T165 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 98221 T165 oass.IndexSchema.readSchema Reading Solr Schema from schema12.xml
   [junit4]   2> 98229 T165 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 98838 T165 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 98842 T165 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 98844 T165 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 98869 T165 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 98873 T165 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 98878 T165 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 98878 T165 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 98879 T165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 98939 T165 oasc.CoreContainer.<init> New CoreContainer 29753798
   [junit4]   2> 98940 T165 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 98941 T165 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 98942 T165 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 98942 T165 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 98943 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 98943 T165 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 98944 T165 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 98944 T165 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 98944 T165 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 98945 T165 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 98955 T165 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 98956 T165 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 98957 T165 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 98962 T166 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 98962 T166 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 98963 T166 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 98964 T166 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 99024 T166 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 99080 T166 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 99103 T166 oass.IndexSchema.readSchema Reading Solr Schema from schema12.xml
   [junit4]   2> 99115 T166 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 99618 T166 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 99622 T166 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 99624 T166 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 99649 T166 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 99654 T166 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 99658 T166 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 99659 T166 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/
   [junit4]   2> 99660 T166 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 99661 T166 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994
   [junit4]   2> 99661 T166 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/index/
   [junit4]   2> 99662 T166 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/index' doesn't exist. Creating new index...
   [junit4]   2> 99662 T166 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/index
   [junit4]   2> 99663 T166 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=14, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 99664 T166 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_1,generation=1}
   [junit4]   2> 99665 T166 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 99665 T166 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 99666 T166 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 99667 T166 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 99668 T166 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 99668 T166 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 99669 T166 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 99669 T166 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 99670 T166 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 99670 T166 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 99671 T166 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 99671 T166 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 99672 T166 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 99672 T166 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 99673 T166 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 99674 T166 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 99675 T166 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 99675 T166 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 99676 T166 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 99677 T166 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 99678 T166 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 99679 T166 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 99680 T166 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 99680 T166 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 99681 T166 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 99682 T166 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 99682 T166 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 99683 T166 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 99684 T166 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99685 T166 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99686 T166 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99687 T166 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99687 T166 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99688 T166 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99689 T166 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99690 T166 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 99691 T166 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 99691 T166 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 99694 T166 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 99697 T166 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 99700 T166 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 99701 T166 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 99702 T166 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=43.8564453125, floorSegmentMB=0.966796875, forceMergeDeletesPctAllowed=19.155562249504047, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 99703 T166 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_1,generation=1}
   [junit4]   2> 99704 T166 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 99705 T166 oass.SolrIndexSearcher.<init> Opening Searcher@69a269a2[collection1] main
   [junit4]   2> 99706 T166 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 99729 T166 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 99778 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@69a269a2[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 99778 T166 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 99781 T165 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 99784 T165 oas.SolrTestCaseJ4.setUp ###Starting testNonStringFieldsValues
   [junit4]   2> ASYNC  NEW_CORE C2497 name=collection1 org.apache.solr.core.SolrCore@3be83be8
   [junit4]   2> 99785 T165 C2497 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 99786 T165 C2497 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 99789 T165 C2497 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 99790 T165 C2497 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_2,generation=2}
   [junit4]   2> 99791 T165 C2497 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 99792 T165 C2497 oass.SolrIndexSearcher.<init> Opening Searcher@4c664c66[collection1] main
   [junit4]   2> 99793 T165 C2497 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 99793 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c664c66[collection1] main{StandardDirectoryReader(segments_2:2:nrt)}
   [junit4]   2> 99794 T165 C2497 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 5
   [junit4]   2> 99799 T165 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 100035 T165 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100038 T165 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_3,generation=3}
   [junit4]   2> 100039 T165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 100042 T165 oass.SolrIndexSearcher.<init> Opening Searcher@7f5d7f5d[collection1] main
   [junit4]   2> 100043 T165 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100043 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f5d7f5d[collection1] main{StandardDirectoryReader(segments_3:4:nrt _0(4.7):C5/1:delGen=1)}
   [junit4]   2> 100044 T165 oas.SolrTestCaseJ4.tearDown ###Ending testNonStringFieldsValues
   [junit4]   2> 100071 T165 oas.SolrTestCaseJ4.setUp ###Starting testMultiThreaded
   [junit4]   2> ASYNC  NEW_CORE C2498 name=collection1 org.apache.solr.core.SolrCore@3be83be8
   [junit4]   2> 100204 T165 C2498 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 100206 T165 C2498 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 134
   [junit4]   2> 100302 T165 C2498 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100303 T165 C2498 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_4,generation=4}
   [junit4]   2> 100304 T165 C2498 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 100305 T165 C2498 oass.SolrIndexSearcher.<init> Opening Searcher@54475447[collection1] main
   [junit4]   2> 100306 T165 C2498 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100306 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54475447[collection1] main{StandardDirectoryReader(segments_4:5:nrt)}
   [junit4]   2> 100307 T165 C2498 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 5
   [junit4]   2> 100320 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100352 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_4,generation=4}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_5,generation=5}
   [junit4]   2> 100353 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
   [junit4]   2> 100392 T176 oass.SolrIndexSearcher.<init> Opening Searcher@349e349e[collection1] main
   [junit4]   2> 100394 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@349e349e[collection1] main{StandardDirectoryReader(segments_5:28:nrt _5(4.7):C23/21:delGen=1)}
   [junit4]   2> 100395 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100396 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100428 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_5,generation=5}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_6,generation=6}
   [junit4]   2> 100429 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
   [junit4]   2> 100467 T178 oass.SolrIndexSearcher.<init> Opening Searcher@24ce24ce[collection1] main
   [junit4]   2> 100476 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100476 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24ce24ce[collection1] main{StandardDirectoryReader(segments_6:47:nrt _f(4.7):C26/23:delGen=1 _c(4.7):C8/7:delGen=1)}
   [junit4]   2> 100479 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100505 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_6,generation=6}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_7,generation=7}
   [junit4]   2> 100508 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
   [junit4]   2> 100511 T177 oass.SolrIndexSearcher.<init> Opening Searcher@475c475c[collection1] main
   [junit4]   2> 100512 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100512 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@475c475c[collection1] main{StandardDirectoryReader(segments_7:57:nrt _k(4.7):C10/6:delGen=1)}
   [junit4]   2> 100513 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100514 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_7,generation=7}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_8,generation=8}
   [junit4]   2> 100515 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 8
   [junit4]   2> 100516 T176 oass.SolrIndexSearcher.<init> Opening Searcher@da10da1[collection1] main
   [junit4]   2> 100517 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100517 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100518 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@da10da1[collection1] main{StandardDirectoryReader(segments_7:57:nrt _k(4.7):C10/6:delGen=1)}
   [junit4]   2> 100523 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_8,generation=8}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_9,generation=9}
   [junit4]   2> 100524 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 9
   [junit4]   2> 100526 T178 oass.SolrIndexSearcher.<init> Opening Searcher@3f4f3f4f[collection1] main
   [junit4]   2> 100527 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100527 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f4f3f4f[collection1] main{StandardDirectoryReader(segments_9:63:nrt _k(4.7):C10/8:delGen=2 _l(4.7):C1 _m(4.7):C1)}
   [junit4]   2> 100528 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100529 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_9,generation=9}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_a,generation=10}
   [junit4]   2> 100531 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 10
   [junit4]   2> 100535 T177 oass.SolrIndexSearcher.<init> Opening Searcher@61f061f[collection1] main
   [junit4]   2> 100536 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100536 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@61f061f[collection1] main{StandardDirectoryReader(segments_a:67:nrt _k(4.7):C10/8:delGen=3 _l(4.7):C1 _n(4.7):C1)}
   [junit4]   2> 100537 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100539 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_a,generation=10}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_b,generation=11}
   [junit4]   2> 100552 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 11
   [junit4]   2> 100556 T176 oass.SolrIndexSearcher.<init> Opening Searcher@48eb48eb[collection1] main
   [junit4]   2> 100557 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100557 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48eb48eb[collection1] main{StandardDirectoryReader(segments_b:71:nrt _k(4.7):C10/8:delGen=3 _o(4.7):C1)}
   [junit4]   2> 100558 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100559 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_b,generation=11}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_c,generation=12}
   [junit4]   2> 100560 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 12
   [junit4]   2> 100563 T178 oass.SolrIndexSearcher.<init> Opening Searcher@17751775[collection1] main
   [junit4]   2> 100563 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100564 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17751775[collection1] main{StandardDirectoryReader(segments_c:74:nrt _k(4.7):C10/9:delGen=3 _o(4.7):C1 _p(4.7):C1)}
   [junit4]   2> 100564 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100568 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_c,generation=12}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_d,generation=13}
   [junit4]   2> 100569 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 13
   [junit4]   2> 100575 T177 oass.SolrIndexSearcher.<init> Opening Searcher@5f895f89[collection1] main
   [junit4]   2> 100575 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100575 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f895f89[collection1] main{StandardDirectoryReader(segments_d:78:nrt _k(4.7):C10/9:delGen=4 _q(4.7):C1)}
   [junit4]   2> 100576 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100577 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_d,generation=13}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_e,generation=14}
   [junit4]   2> 100578 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 14
   [junit4]   2> 100582 T176 oass.SolrIndexSearcher.<init> Opening Searcher@75dc75dc[collection1] main
   [junit4]   2> 100583 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100583 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@75dc75dc[collection1] main{StandardDirectoryReader(segments_e:82:nrt _k(4.7):C10/9:delGen=4 _r(4.7):C1)}
   [junit4]   2> 100585 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100586 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_e,generation=14}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_f,generation=15}
   [junit4]   2> 100587 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 15
   [junit4]   2> 100589 T178 oass.SolrIndexSearcher.<init> Opening Searcher@23d923d9[collection1] main
   [junit4]   2> 100590 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100590 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23d923d9[collection1] main{StandardDirectoryReader(segments_f:84:nrt _k(4.7):C10/9:delGen=4 _r(4.7):C1 _s(4.7):C1)}
   [junit4]   2> 100591 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100594 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_f,generation=15}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_g,generation=16}
   [junit4]   2> 100595 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 16
   [junit4]   2> 100598 T177 oass.SolrIndexSearcher.<init> Opening Searcher@2c5a2c5a[collection1] main
   [junit4]   2> 100598 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100599 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c5a2c5a[collection1] main{StandardDirectoryReader(segments_g:88:nrt _k(4.7):C10/9:delGen=4 _s(4.7):C1 _t(4.7):C1)}
   [junit4]   2> 100601 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100603 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_g,generation=16}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_h,generation=17}
   [junit4]   2> 100604 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 17
   [junit4]   2> 100608 T176 oass.SolrIndexSearcher.<init> Opening Searcher@56415641[collection1] main
   [junit4]   2> 100609 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100610 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100610 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56415641[collection1] main{StandardDirectoryReader(segments_h:94:nrt _k(4.7):C10/9:delGen=4 _u(4.7):C1)}
   [junit4]   2> 100611 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_h,generation=17}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_i,generation=18}
   [junit4]   2> 100612 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 18
   [junit4]   2> 100613 T178 oass.SolrIndexSearcher.<init> Opening Searcher@56df56df[collection1] main
   [junit4]   2> 100614 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100614 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56df56df[collection1] main{StandardDirectoryReader(segments_h:94:nrt _k(4.7):C10/9:delGen=4 _u(4.7):C1)}
   [junit4]   2> 100616 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100617 T177 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 100620 T177 oass.SolrIndexSearcher.<init> Opening Searcher@5d875d87[collection1] main
   [junit4]   2> 100621 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100621 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d875d87[collection1] main{StandardDirectoryReader(segments_i:99:nrt _u(4.7):C1 _v(4.7):C1)}
   [junit4]   2> 100621 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100634 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_i,generation=18}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_j,generation=19}
   [junit4]   2> 100635 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 19
   [junit4]   2> 100638 T176 oass.SolrIndexSearcher.<init> Opening Searcher@220a220a[collection1] main
   [junit4]   2> 100640 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100640 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@220a220a[collection1] main{StandardDirectoryReader(segments_j:106:nrt _u(4.7):C1 _x(4.7):C1)}
   [junit4]   2> 100640 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100645 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_j,generation=19}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_k,generation=20}
   [junit4]   2> 100647 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 20
   [junit4]   2> 100649 T178 oass.SolrIndexSearcher.<init> Opening Searcher@172b172b[collection1] main
   [junit4]   2> 100651 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100651 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@172b172b[collection1] main{StandardDirectoryReader(segments_k:110:nrt _x(4.7):C1 _y(4.7):C1)}
   [junit4]   2> 100652 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100653 T177 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 100654 T177 oass.SolrIndexSearcher.<init> Opening Searcher@49384938[collection1] main
   [junit4]   2> 100655 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100655 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49384938[collection1] main{StandardDirectoryReader(segments_k:110:nrt _x(4.7):C1 _y(4.7):C1)}
   [junit4]   2> 100655 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100659 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_k,generation=20}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_l,generation=21}
   [junit4]   2> 100660 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 21
   [junit4]   2> 100664 T176 oass.SolrIndexSearcher.<init> Opening Searcher@ce00ce0[collection1] main
   [junit4]   2> 100665 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100665 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ce00ce0[collection1] main{StandardDirectoryReader(segments_l:118:nrt _10(4.7):C1)}
   [junit4]   2> 100665 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100667 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_l,generation=21}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_m,generation=22}
   [junit4]   2> 100668 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 22
   [junit4]   2> 100671 T178 oass.SolrIndexSearcher.<init> Opening Searcher@4da04da0[collection1] main
   [junit4]   2> 100672 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100672 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4da04da0[collection1] main{StandardDirectoryReader(segments_m:120:nrt _10(4.7):C1 _11(4.7):C1)}
   [junit4]   2> 100673 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100680 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_m,generation=22}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_n,generation=23}
   [junit4]   2> 100681 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 23
   [junit4]   2> 100683 T177 oass.SolrIndexSearcher.<init> Opening Searcher@59f459f4[collection1] main
   [junit4]   2> 100684 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100684 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59f459f4[collection1] main{StandardDirectoryReader(segments_n:124:nrt _10(4.7):C1 _12(4.7):C1)}
   [junit4]   2> 100684 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100686 T176 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 100686 T176 oass.SolrIndexSearcher.<init> Opening Searcher@38b638b6[collection1] main
   [junit4]   2> 100688 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100688 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38b638b6[collection1] main{StandardDirectoryReader(segments_n:124:nrt _10(4.7):C1 _12(4.7):C1)}
   [junit4]   2> 100688 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100692 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_n,generation=23}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_o,generation=24}
   [junit4]   2> 100693 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 24
   [junit4]   2> 100696 T178 oass.SolrIndexSearcher.<init> Opening Searcher@66896689[collection1] main
   [junit4]   2> 100697 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100697 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66896689[collection1] main{StandardDirectoryReader(segments_o:130:nrt _10(4.7):C1 _13(4.7):C1 _14(4.7):C1)}
   [junit4]   2> 100699 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100700 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_o,generation=24}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_p,generation=25}
   [junit4]   2> 100701 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 25
   [junit4]   2> 100704 T177 oass.SolrIndexSearcher.<init> Opening Searcher@420a420a[collection1] main
   [junit4]   2> 100705 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@420a420a[collection1] main{StandardDirectoryReader(segments_p:134:nrt _10(4.7):C1 _14(4.7):C1 _15(4.7):C1)}
   [junit4]   2> 100706 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100707 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100709 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_p,generation=25}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_q,generation=26}
   [junit4]   2> 100710 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 26
   [junit4]   2> 100713 T176 oass.SolrIndexSearcher.<init> Opening Searcher@72997299[collection1] main
   [junit4]   2> 100721 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100722 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72997299[collection1] main{StandardDirectoryReader(segments_q:140:nrt _16(4.7):C1)}
   [junit4]   2> 100722 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100724 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_q,generation=26}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_r,generation=27}
   [junit4]   2> 100725 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 27
   [junit4]   2> 100728 T178 oass.SolrIndexSearcher.<init> Opening Searcher@e000e0[collection1] main
   [junit4]   2> 100729 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100729 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e000e0[collection1] main{StandardDirectoryReader(segments_r:144:nrt _17(4.7):C1)}
   [junit4]   2> 100730 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100734 T177 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_r,generation=27}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_s,generation=28}
   [junit4]   2> 100734 T177 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 28
   [junit4]   2> 100739 T177 oass.SolrIndexSearcher.<init> Opening Searcher@62416241[collection1] main
   [junit4]   2> 100740 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100740 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62416241[collection1] main{StandardDirectoryReader(segments_s:148:nrt _18(4.7):C1)}
   [junit4]   2> 100743 T176 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100744 T176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_s,generation=28}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_t,generation=29}
   [junit4]   2> 100745 T176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 29
   [junit4]   2> 100748 T176 oass.SolrIndexSearcher.<init> Opening Searcher@39933993[collection1] main
   [junit4]   2> 100749 T176 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100749 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39933993[collection1] main{StandardDirectoryReader(segments_t:152:nrt _19(4.7):C1)}
   [junit4]   2> 100750 T178 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100752 T178 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_t,generation=29}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_u,generation=30}
   [junit4]   2> 100753 T178 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 30
   [junit4]   2> 100754 T178 oass.SolrIndexSearcher.<init> Opening Searcher@733a733a[collection1] main
   [junit4]   2> 100755 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@733a733a[collection1] main{StandardDirectoryReader(segments_t:152:nrt _19(4.7):C1)}
   [junit4]   2> 100755 T178 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100756 T177 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100757 T177 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 100757 T177 oass.SolrIndexSearcher.<init> Opening Searcher@40404040[collection1] main
   [junit4]   2> 100758 T177 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100758 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40404040[collection1] main{StandardDirectoryReader(segments_t:152:nrt _19(4.7):C1)}
   [junit4]   2> ASYNC  NEW_CORE C2499 name=collection1 org.apache.solr.core.SolrCore@3be83be8
   [junit4]   2> 100760 T165 C2499 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100761 T165 C2499 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 100762 T165 C2499 oass.SolrIndexSearcher.<init> Opening Searcher@688b688b[collection1] main
   [junit4]   2> 100764 T165 C2499 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100764 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@688b688b[collection1] main{StandardDirectoryReader(segments_t:152:nrt _19(4.7):C1)}
   [junit4]   2> 100765 T165 C2499 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 5
   [junit4]   2> 100767 T165 oas.SolrTestCaseJ4.tearDown ###Ending testMultiThreaded
   [junit4]   2> 100780 T165 oas.SolrTestCaseJ4.setUp ###Starting testDupeDetection
   [junit4]   2> 100781 T165 C2499 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 100781 T165 C2499 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 0
   [junit4]   2> 100783 T165 C2499 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100784 T165 C2499 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_u,generation=30}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_v,generation=31}
   [junit4]   2> 100785 T165 C2499 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 31
   [junit4]   2> 100786 T165 C2499 oass.SolrIndexSearcher.<init> Opening Searcher@7ab67ab6[collection1] main
   [junit4]   2> 100787 T165 C2499 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100787 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ab67ab6[collection1] main{StandardDirectoryReader(segments_v:153:nrt)}
   [junit4]   2> 100789 T165 C2499 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 6
   [junit4]   2> 100797 T165 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100800 T165 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_v,generation=31}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_w,generation=32}
   [junit4]   2> 100802 T165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 32
   [junit4]   2> 100803 T165 oass.SolrIndexSearcher.<init> Opening Searcher@48664866[collection1] main
   [junit4]   2> 100804 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48664866[collection1] main{StandardDirectoryReader(segments_w:155:nrt _1a(4.7):C2)}
   [junit4]   2> 100805 T165 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100810 T165 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100814 T165 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_w,generation=32}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_x,generation=33}
   [junit4]   2> 100815 T165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 33
   [junit4]   2> 100826 T165 oass.SolrIndexSearcher.<init> Opening Searcher@7b787b78[collection1] main
   [junit4]   2> 100827 T165 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100827 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7b787b78[collection1] main{StandardDirectoryReader(segments_x:158:nrt _1a(4.7):C2/1:delGen=1 _1b(4.7):C1)}
   [junit4]   2> 100829 T165 oas.SolrTestCaseJ4.tearDown ###Ending testDupeDetection
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SignatureUpdateProcessorFactoryTest -Dtests.method=testDupeDetection -Dtests.seed=2819D790A0731391 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs_CZ_PREEURO -Dtests.timezone=Canada/Yukon -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.07s J1 | SignatureUpdateProcessorFactoryTest.testDupeDetection <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but was:<2>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2819D790A0731391:73292C58A334B0ED]:0)
   [junit4]    > 	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.checkNumDocs(SignatureUpdateProcessorFactoryTest.java:71)
   [junit4]    > 	at org.apache.solr.update.processor.SignatureUpdateProcessorFactoryTest.testDupeDetection(SignatureUpdateProcessorFactoryTest.java:119)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:738)
   [junit4]   2> 100854 T165 oas.SolrTestCaseJ4.setUp ###Starting testFailNonIndexedSigWithOverwriteDupes
   [junit4]   2> ASYNC  NEW_CORE C2500 name=collection1 org.apache.solr.core.SolrCore@3be83be8
   [junit4]   2> 100855 T165 C2500 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 100855 T165 C2500 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 100858 T165 C2500 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100859 T165 C2500 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_x,generation=33}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_y,generation=34}
   [junit4]   2> 100860 T165 C2500 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 34
   [junit4]   2> 100860 T165 C2500 oass.SolrIndexSearcher.<init> Opening Searcher@88c088c[collection1] main
   [junit4]   2> 100862 T165 C2500 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100862 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@88c088c[collection1] main{StandardDirectoryReader(segments_y:159:nrt)}
   [junit4]   2> 100863 T165 C2500 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 5
   [junit4]   2> 100865 T165 oas.SolrTestCaseJ4.tearDown ###Ending testFailNonIndexedSigWithOverwriteDupes
   [junit4]   2> 100876 T165 oas.SolrTestCaseJ4.setUp ###Starting testNonIndexedSignatureField
   [junit4]   2> 100877 T165 C2500 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 100878 T165 C2500 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 100880 T165 C2500 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100881 T165 C2500 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_y,generation=34}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_z,generation=35}
   [junit4]   2> 100882 T165 C2500 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 35
   [junit4]   2> 100884 T165 C2500 oass.SolrIndexSearcher.<init> Opening Searcher@6e556e55[collection1] main
   [junit4]   2> 100885 T165 C2500 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100885 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e556e55[collection1] main{StandardDirectoryReader(segments_z:160:nrt)}
   [junit4]   2> 100886 T165 C2500 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 6
   [junit4]   2> 100893 T165 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100895 T165 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_z,generation=35}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_10,generation=36}
   [junit4]   2> 100896 T165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 36
   [junit4]   2> 100897 T165 oass.SolrIndexSearcher.<init> Opening Searcher@24f324f3[collection1] main
   [junit4]   2> 100898 T165 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100898 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24f324f3[collection1] main{StandardDirectoryReader(segments_10:162:nrt _1c(4.7):C2)}
   [junit4]   2> 100900 T165 oas.SolrTestCaseJ4.tearDown ###Ending testNonIndexedSignatureField
   [junit4]   2> 100910 T165 oas.SolrTestCaseJ4.setUp ###Starting testDupeAllFieldsDetection
   [junit4]   2> 100911 T165 C2500 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 100912 T165 C2500 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 2
   [junit4]   2> 100914 T165 C2500 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100915 T165 C2500 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_10,generation=36}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_11,generation=37}
   [junit4]   2> 100916 T165 C2500 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 37
   [junit4]   2> ASYNC  NEW_CORE C2501 name=collection1 org.apache.solr.core.SolrCore@3be83be8
   [junit4]   2> 100934 T165 C2501 oass.SolrIndexSearcher.<init> Opening Searcher@274f274f[collection1] main
   [junit4]   2> 100935 T165 C2501 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100935 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@274f274f[collection1] main{StandardDirectoryReader(segments_11:163:nrt)}
   [junit4]   2> 100937 T165 C2501 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 23
   [junit4]   2> 100943 T165 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 100945 T165 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_11,generation=37}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@30ac30ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39b439b4)),segFN=segments_12,generation=38}
   [junit4]   2> 100945 T165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 38
   [junit4]   2> 100947 T165 oass.SolrIndexSearcher.<init> Opening Searcher@62e662e6[collection1] main
   [junit4]   2> 100948 T165 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 100948 T167 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62e662e6[collection1] main{StandardDirectoryReader(segments_12:165:nrt _1d(4.7):C3)}
   [junit4]   2> 100949 T165 oas.SolrTestCaseJ4.tearDown ###Ending testDupeAllFieldsDetection
   [junit4]   2> 100957 T165 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 100957 T165 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=29753798
   [junit4]   2> 100958 T165 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3be83be8
   [junit4]   2> 100958 T165 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=42,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=253,cumulative_deletesById=0,cumulative_deletesByQuery=6,cumulative_errors=0}
   [junit4]   2> 100959 T165 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 100959 T165 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 100960 T165 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 100961 T165 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 100962 T165 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 100962 T165 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/index;done=false>>]
   [junit4]   2> 100963 T165 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994/index
   [junit4]   2> 100963 T165 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994;done=false>>]
   [junit4]   2> 100964 T165 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solrtest-SignatureUpdateProcessorFactoryTest-1392567461994
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=cs_CZ_PREEURO, timezone=Canada/Yukon
   [junit4]   2> NOTE: Linux 3.8.0-35-generic amd64/IBM Corporation 1.6.0 (64-bit)/cpus=8,threads=1,free=4779048,total=44516352
   [junit4]   2> NOTE: All tests run in this JVM: [RAMDirectoryFactoryTest, DateFieldTest, TestFastLRUCache, FullSolrCloudDistribCmdsTest, TestFastWriter, TestCopyFieldCollectionResource, TestFiltering, TestSolrCoreProperties, SpellCheckComponentTest, TestWordDelimiterFilterFactory, TestNumberUtils, OpenCloseCoreStressTest, OverseerRolesTest, TestFoldingMultitermQuery, SignatureUpdateProcessorFactoryTest]
   [junit4] Completed on J1 in 3.03s, 6 tests, 1 failure <<< FAILURES!

[...truncated 1030 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:452: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 362 suites, 1563 tests, 1 failure, 71 ignored (7 assumptions)

Total time: 44 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/ibm-j9-jdk6 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0-fcs-b129) - Build # 9388 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/9388/
Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseSerialGC

5 tests failed.
REGRESSION:  org.apache.solr.cloud.DistribCursorPagingTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:33091/collection1, https://127.0.0.1:42235/collection1, https://127.0.0.1:60140/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:33091/collection1, https://127.0.0.1:42235/collection1, https://127.0.0.1:60140/collection1]
	at __randomizedtesting.SeedInfo.seed([5403E38B5618D23A:D5E56D932147B206]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:532)
	at org.apache.solr.cloud.DistribCursorPagingTest.doSimpleTest(DistribCursorPagingTest.java:257)
	at org.apache.solr.cloud.DistribCursorPagingTest.doTest(DistribCursorPagingTest.java:89)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 49 more


FAILED:  org.apache.solr.TestDistributedGrouping.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /o_qr/p/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /o_qr/p/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([5403E38B5618D23A:D5E56D932147B206]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedGrouping.doTest(TestDistributedGrouping.java:156)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch

Error Message:
Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Server Error</title> </head> <body> <h2>HTTP ERROR: 500</h2> <p>Problem accessing /krogm/ev/select. Reason: <pre>    Server Error</pre></p> <hr /><i><small>Powered by Jetty://</small></i>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /krogm/ev/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([5403E38B5618D23A:D5E56D932147B206]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:515)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:177)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:876)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:59952/collection1, https://127.0.0.1:49517/collection1, https://127.0.0.1:35032/collection1, https://127.0.0.1:55879/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:59952/collection1, https://127.0.0.1:49517/collection1, https://127.0.0.1:35032/collection1, https://127.0.0.1:55879/collection1]
	at __randomizedtesting.SeedInfo.seed([5403E38B5618D23A:D5E56D932147B206]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:524)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkQueries(AbstractFullDistribZkTestBase.java:797)
	at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:101)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 50 more


FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:43803/zc_m/rz/collection1, https://127.0.0.1:36202/zc_m/rz/collection1, https://127.0.0.1:42669/zc_m/rz/collection1, https://127.0.0.1:41112/zc_m/rz/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:43803/zc_m/rz/collection1, https://127.0.0.1:36202/zc_m/rz/collection1, https://127.0.0.1:42669/zc_m/rz/collection1, https://127.0.0.1:41112/zc_m/rz/collection1]
	at __randomizedtesting.SeedInfo.seed([5403E38B5618D23A:D5E56D932147B206]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
	at org.apache.solr.cloud.BasicDistributedZkTest.queryServer(BasicDistributedZkTest.java:1176)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:545)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:264)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 Server Error</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /zc_m/rz/collection1/select. Reason:
<pre>    Server Error</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
                                                
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
	... 48 more




Build Log:
[...truncated 10310 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedGrouping
   [junit4]   2> 308231 T1033 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 308231 T1033 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /o_qr/p
   [junit4]   2> 308234 T1033 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 308235 T1033 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 308237 T1033 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 308241 T1033 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:54885
   [junit4]   2> 308242 T1033 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 308242 T1033 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 308243 T1033 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 308243 T1033 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 308255 T1033 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/solr.xml
   [junit4]   2> 308270 T1033 oasc.CoreContainer.<init> New CoreContainer 2719027
   [junit4]   2> 308270 T1033 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 308271 T1033 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 308271 T1033 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 308271 T1033 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 308271 T1033 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 308272 T1033 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 308272 T1033 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 308272 T1033 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 308273 T1033 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 308273 T1033 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 308276 T1033 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 308276 T1033 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 308277 T1033 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 308278 T1043 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 308279 T1043 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 308279 T1043 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 308279 T1043 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 308307 T1043 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 308332 T1043 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 308332 T1043 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 308338 T1043 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 308468 T1043 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 308469 T1043 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 308470 T1043 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 308474 T1043 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 308475 T1043 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 308481 T1043 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 308483 T1043 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 308485 T1043 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 308485 T1043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 308485 T1043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 308485 T1043 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 308486 T1043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 308486 T1043 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 308486 T1043 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 308486 T1043 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedGrouping-1392562501602/control/data/
   [junit4]   2> 308486 T1043 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e3b357
   [junit4]   2> 308487 T1043 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392562501602/control/data
   [junit4]   2> 308487 T1043 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedGrouping-1392562501602/control/data/index/
   [junit4]   2> 308487 T1043 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedGrouping-1392562501602/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 308488 T1043 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392562501602/control/data/index
   [junit4]   2> 308488 T1043 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6882718625200945]
   [junit4]   2> 308489 T1043 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@10c9b79 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ee6dc9)),segFN=segments_1,generation=1}
   [junit4]   2> 308489 T1043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 308490 T1043 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 308492 T1043 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 308493 T1043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 308493 T1043 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 308493 T1043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 308493 T1043 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 308494 T1043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 308494 T1043 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 308494 T1043 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 308494 T1043 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 308495 T1043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 308495 T1043 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 308495 T1043 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 308495 T1043 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 308496 T1043 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 308496 T1043 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 308496 T1043 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 308497 T1043 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 308497 T1043 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 308497 T1043 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 308498 T1043 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 308498 T1043 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 308499 T1043 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 308499 T1043 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 308499 T1043 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 308500 T1043 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 308500 T1043 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 308501 T1043 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308501 T1043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308501 T1043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308502 T1043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308503 T1043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308503 T1043 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308504 T1043 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308504 T1043 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308505 T1043 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 308505 T1043 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 308507 T1043 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 308508 T1043 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 308510 T1043 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 308510 T1043 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 308510 T1043 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=88.705078125, floorSegmentMB=0.73828125, forceMergeDeletesPctAllowed=24.483662204160062, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 308511 T1043 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@10c9b79 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ee6dc9)),segFN=segments_1,generation=1}
   [junit4]   2> 308511 T1043 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 308511 T1043 oass.SolrIndexSearcher.<init> Opening Searcher@15e4a2e[collection1] main
   [junit4]   2> 308512 T1043 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 308571 T1043 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 308590 T1044 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15e4a2e[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 308595 T1043 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 308595 T1033 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 308596 T1033 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 308598 T1033 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 308600 T1033 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 308601 T1033 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38529
   [junit4]   2> 308603 T1033 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 308603 T1033 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 308603 T1033 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr
   [junit4]   2> 308604 T1033 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 308624 T1033 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/solr.xml
   [junit4]   2> 308632 T1033 oasc.CoreContainer.<init> New CoreContainer 11371935
   [junit4]   2> 308633 T1033 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 308633 T1033 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 308634 T1033 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 308634 T1033 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 308634 T1033 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 308635 T1033 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 308635 T1033 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 308635 T1033 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 308635 T1033 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 308636 T1033 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 308639 T1033 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 308639 T1033 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 308640 T1033 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 308641 T1055 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 308642 T1055 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 308642 T1055 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 308642 T1055 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 308680 T1055 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 308716 T1055 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 308716 T1055 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 308722 T1055 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 308850 T1055 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 308851 T1055 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 308852 T1055 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 308856 T1055 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 308857 T1055 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 308862 T1055 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 308863 T1055 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 308865 T1055 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 308865 T1055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 308865 T1055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 308866 T1055 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 308866 T1055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 308866 T1055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 308866 T1055 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 308867 T1055 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=./org.apache.solr.TestDistributedGrouping-1392562501602/shard0/data/
   [junit4]   2> 308867 T1055 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e3b357
   [junit4]   2> 308867 T1055 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392562501602/shard0/data
   [junit4]   2> 308868 T1055 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.TestDistributedGrouping-1392562501602/shard0/data/index/
   [junit4]   2> 308868 T1055 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.TestDistributedGrouping-1392562501602/shard0/data/index' doesn't exist. Creating new index...
   [junit4]   2> 308868 T1055 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.TestDistributedGrouping-1392562501602/shard0/data/index
   [junit4]   2> 308868 T1055 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6882718625200945]
   [junit4]   2> 308869 T1055 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@813419 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1d65129)),segFN=segments_1,generation=1}
   [junit4]   2> 308869 T1055 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 308869 T1055 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 308872 T1055 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 308872 T1055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 308872 T1055 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 308873 T1055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 308873 T1055 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 308873 T1055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 308873 T1055 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 308873 T1055 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 308874 T1055 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 308874 T1055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 308874 T1055 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 308874 T1055 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 308875 T1055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 308875 T1055 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 308875 T1055 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 308875 T1055 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 308876 T1055 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 308876 T1055 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 308877 T1055 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 308878 T1055 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 308878 T1055 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 308879 T1055 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 308879 T1055 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 308879 T1055 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 308880 T1055 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 308880 T1055 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 308881 T1055 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308881 T1055 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308882 T1055 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308882 T1055 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308883 T1055 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308884 T1055 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308884 T1055 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308885 T1055 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 308885 T1055 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 308886 T1055 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 308888 T1055 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 308888 T1055 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 308890 T1055 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 308890 T1055 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 308891 T1055 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=88.705078125, floorSegmentMB=0.73828125, forceMergeDeletesPctAllowed=24.483662204160062, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 308891 T1055 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@813419 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1d65129)),segFN=segments_1,generation=1}
   [junit4]   2> 308892 T1055 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 308892 T1055 oass.SolrIndexSearcher.<init> Opening Searcher@2d5ca3[collection1] main
   [junit4]   2> 308892 T1055 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 308897 T1055 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 308927 T1056 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d5ca3[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 308935 T1055 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 308936 T1033 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 308936 T1033 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C1424 name=collection1 org.apache.solr.core.SolrCore@19ee31d
   [junit4]   2> 308997 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1460207618478833664)} 0 1
   [junit4]   2> ASYNC  NEW_CORE C1425 name=collection1 org.apache.solr.core.SolrCore@11b4975
   [junit4]   2> 309058 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1460207618541748224)} 0 2
   [junit4]   2> 309060 T1040 C1424 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 309061 T1040 C1424 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 309061 T1040 C1424 oass.SolrIndexSearcher.<init> Opening Searcher@10c03f9[collection1] main
   [junit4]   2> 309062 T1040 C1424 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 309065 T1044 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10c03f9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 309066 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 6
   [junit4]   2> 309069 T1051 C1425 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 309069 T1051 C1425 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 309069 T1051 C1425 oass.SolrIndexSearcher.<init> Opening Searcher@1538dd2[collection1] main
   [junit4]   2> 309070 T1051 C1425 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 309073 T1056 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1538dd2[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 309074 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 5
   [junit4]   2> 309079 T1042 C1424 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&distrib=false&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_si&group=true} hits=0 status=0 QTime=3 
   [junit4]   2> 309149 T1053 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={group.distributed.first=true&distrib=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p|[ff01::213]:33332/o_qr/p|[ff01::083]:33332/o_qr/p&rows=100&version=2&q=*:*&NOW=1392562502451&isShard=true&wt=javabin&group.field=a_si&group=true} status=0 QTime=7 
   [junit4]   2> 309160 T1052 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&shards=https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p|[ff01::213]:33332/o_qr/p|[ff01::083]:33332/o_qr/p&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_si&group=true} status=0 QTime=77 
   [junit4]   2> 309177 T1039 C1424 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&distrib=false&hl=true&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&hl.fl=a_t&rows=100&wt=javabin&version=2&group.field=a_si&group=true} hits=0 status=0 QTime=15 
   [junit4]   2> 309182 T1051 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={group.distributed.first=true&distrib=false&hl=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=https://127.0.0.1:38529/o_qr/p|[ff01::083]:33332/o_qr/p&rows=100&version=2&q=*:*&NOW=1392562502548&isShard=true&hl.fl=a_t&wt=javabin&group.field=a_si&group=true} status=0 QTime=1 
   [junit4]   2> 309182 T1054 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&shards=https://127.0.0.1:38529/o_qr/p|[ff01::083]:33332/o_qr/p&hl=true&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&hl.fl=a_t&rows=100&wt=javabin&version=2&group.field=a_si&group=true} status=0 QTime=2 
   [junit4]   2> 309185 T1041 C1424 oasr.UnInvertedField.<init> UnInverted multi-valued field {field=a_t,memSize=4288,tindexSize=0,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
   [junit4]   2> 309186 T1041 C1424 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&facet.field=a_t&distrib=false&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&facet=true&wt=javabin&version=2&group.field=a_si&group=true} hits=0 status=0 QTime=2 
   [junit4]   2> 309191 T1052 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={facet.field=a_t&group.distributed.first=true&distrib=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=https://127.0.0.1:38529/o_qr/p&rows=100&version=2&q=*:*&NOW=1392562502557&isShard=true&facet=false&wt=javabin&group.field=a_si&group=true} status=0 QTime=0 
   [junit4]   2> 309203 T1051 C1425 oasr.UnInvertedField.<init> UnInverted multi-valued field {field=a_t,memSize=4288,tindexSize=0,time=0,phase1=0,nTerms=0,bigTerms=0,termInstances=0,uses=0}
   [junit4]   2> 309203 T1051 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={facet.field=a_t&distrib=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=https://127.0.0.1:38529/o_qr/p&rows=100&version=2&group.distributed.second=true&q=*:*&f.a_t.facet.limit=160&NOW=1392562502557&isShard=true&facet=true&wt=javabin&group.field=a_si&group=true} status=0 QTime=5 
   [junit4]   2> 309208 T1053 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&shards=https://127.0.0.1:38529/o_qr/p&facet.field=a_t&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&facet=true&wt=javabin&version=2&group.field=a_si&group=true} status=0 QTime=19 
   [junit4]   2> 309211 T1040 C1424 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&distrib=false&stats=true&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_si&group=true&stats.field=a_si} hits=0 status=0 QTime=1 
   [junit4]   2> 309219 T1052 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={group.distributed.first=true&distrib=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p&rows=100&version=2&q=*:*&stats=false&NOW=1392562502581&isShard=true&wt=javabin&group.field=a_si&group=true&stats.field=a_si} status=0 QTime=0 
   [junit4]   2> 309222 T1051 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={distrib=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p&rows=100&version=2&group.distributed.second=true&q=*:*&stats=true&NOW=1392562502581&isShard=true&wt=javabin&group.field=a_si&group=true&stats.field=a_si} status=0 QTime=0 
   [junit4]   2> 309223 T1054 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={q=*:*&shards=https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p&stats=true&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&wt=javabin&version=2&group.field=a_si&group=true&stats.field=a_si} status=0 QTime=10 
   [junit4]   2> 309240 T1042 C1424 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={distrib=false&qt=spellCheckCompRH&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&version=2&spellcheck.build=true&q=kings&spellcheck=true&wt=javabin&group.field=a_si&group=true} hits=0 status=0 QTime=15 
   [junit4]   2> 309272 T1052 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={group.distributed.first=true&distrib=false&fl=id&group.limit=10&start=0&sort=a_si+asc,+id+asc&shard.url=[ff01::213]:33332/o_qr/p|https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p&rows=100&version=2&spellcheck.build=true&spellcheck.extendedResults=false&q=kings&spellcheck=true&NOW=1392562502611&spellcheck.onlyMorePopular=false&isShard=true&spellcheck.count=5&wt=javabin&group.field=a_si&group=true} status=0 QTime=1 
   [junit4]   2> 309274 T1053 C1425 oashc.SpellCheckComponent.finishStage [ff01::213]:33332/o_qr/p|https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p null
   [junit4]   2> 309274 T1053 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={qt=spellCheckCompRH&fl=id,a_si&group.limit=10&sort=a_si+asc,+id+asc&rows=100&version=2&spellcheck.build=true&q=kings&shards=[ff01::213]:33332/o_qr/p|https://127.0.0.1:38529/o_qr/p|[ff01::114]:33332/o_qr/p&spellcheck=true&wt=javabin&group.field=a_si&group=true} status=0 QTime=31 
   [junit4]   2> 309279 T1039 C1424 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={facet.field=a_t&distrib=false&fl=id,a_si&group.limit=10&fq=a_s:a&sort=a_si+asc,+id+asc&rows=100&version=2&q=*:*&group.truncate=true&facet=true&wt=javabin&group.field=a_si&group=true} hits=0 status=0 QTime=3 
   [junit4]   2> 309283 T1054 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={facet.field=a_t&group.distributed.first=true&distrib=false&fl=id&group.limit=10&start=0&fq=a_s:a&sort=a_si+asc,+id+asc&shard.url=[ff01::213]:33332/o_qr/p|[ff01::114]:33332/o_qr/p|[ff01::083]:33332/o_qr/p|https://127.0.0.1:38529/o_qr/p&rows=100&version=2&q=*:*&group.truncate=true&NOW=1392562502649&isShard=true&facet=false&wt=javabin&group.field=a_si&group=true} status=0 QTime=0 
   [junit4]   2> 309292 T1052 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={facet.field=a_t&distrib=false&fl=id&group.limit=10&start=0&fq=a_s:a&sort=a_si+asc,+id+asc&shard.url=[ff01::213]:33332/o_qr/p|[ff01::114]:33332/o_qr/p|[ff01::083]:33332/o_qr/p|https://127.0.0.1:38529/o_qr/p&rows=100&version=2&group.distributed.second=true&q=*:*&f.a_t.facet.limit=160&group.truncate=true&NOW=1392562502649&isShard=true&facet=true&wt=javabin&group.field=a_si&group=true} status=0 QTime=6 
   [junit4]   2> 309293 T1051 C1425 oasc.SolrCore.execute [collection1] webapp=/o_qr/p path=/select params={facet.field=a_t&fl=id,a_si&group.limit=10&fq=a_s:a&sort=a_si+asc,+id+asc&rows=100&version=2&q=*:*&shards=[ff01::213]:33332/o_qr/p|[ff01::114]:33332/o_qr/p|[ff01::083]:33332/o_qr/p|https://127.0.0.1:38529/o_qr/p&group.truncate=true&facet=true&wt=javabin&group.field=a_si&group=true} status=0 QTime=12 
   [junit4]   2> 309299 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[1 (1460207618794455040)]} 0 3
   [junit4]   2> 309303 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[1 (1460207618799697920)]} 0 1
   [junit4]   2> 309309 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[2 (1460207618804940800)]} 0 2
   [junit4]   2> 309314 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[2 (1460207618810183680)]} 0 2
   [junit4]   2> 309318 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[3 (1460207618815426560)]} 0 1
   [junit4]   2> 309323 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[3 (1460207618819620864)]} 0 2
   [junit4]   2> 309326 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[4 (1460207618823815168)]} 0 1
   [junit4]   2> 309329 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[4 (1460207618826960896)]} 0 1
   [junit4]   2> 309332 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[5 (1460207618830106624)]} 0 1
   [junit4]   2> 309335 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[5 (1460207618833252352)]} 0 1
   [junit4]   2> 309338 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[6 (1460207618836398080)]} 0 1
   [junit4]   2> 309341 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[6 (1460207618839543808)]} 0 1
   [junit4]   2> 309344 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[7 (1460207618842689536)]} 0 1
   [junit4]   2> 309346 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[7 (1460207618845835264)]} 0 0
   [junit4]   2> 309349 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[8 (1460207618848980992)]} 0 0
   [junit4]   2> 309352 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[8 (1460207618852126720)]} 0 0
   [junit4]   2> 309355 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[9 (1460207618855272448)]} 0 0
   [junit4]   2> 309358 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[9 (1460207618858418176)]} 0 0
   [junit4]   2> 309362 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[10 (1460207618861563904)]} 0 1
   [junit4]   2> 309365 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[10 (1460207618864709632)]} 0 1
   [junit4]   2> 309368 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[11 (1460207618867855360)]} 0 1
   [junit4]   2> 309371 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[11 (1460207618871001088)]} 0 1
   [junit4]   2> 309374 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[12 (1460207618874146816)]} 0 1
   [junit4]   2> 309376 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[12 (1460207618877292544)]} 0 0
   [junit4]   2> 309379 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[14 (1460207618880438272)]} 0 0
   [junit4]   2> 309382 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[14 (1460207618882535424)]} 0 1
   [junit4]   2> 309386 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[15 (1460207618885681152)]} 0 2
   [junit4]   2> 309390 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[15 (1460207618890924032)]} 0 1
   [junit4]   2> 309395 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[16 (1460207618896166912)]} 0 1
   [junit4]   2> 309399 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[16 (1460207618900361216)]} 0 1
   [junit4]   2> 309405 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[17 (1460207618905604096)]} 0 2
   [junit4]   2> 309409 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[17 (1460207618910846976)]} 0 2
   [junit4]   2> 309413 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[18 (1460207618915041280)]} 0 1
   [junit4]   2> 309416 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[18 (1460207618919235584)]} 0 1
   [junit4]   2> 309419 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[19 (1460207618922381312)]} 0 0
   [junit4]   2> 309422 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[19 (1460207618924478464)]} 0 1
   [junit4]   2> 309425 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[20 (1460207618927624192)]} 0 1
   [junit4]   2> 309428 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[20 (1460207618931818496)]} 0 0
   [junit4]   2> 309431 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[21 (1460207618934964224)]} 0 0
   [junit4]   2> 309435 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[21 (1460207618938109952)]} 0 1
   [junit4]   2> 309440 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[22 (1460207618942304256)]} 0 2
   [junit4]   2> 309443 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[22 (1460207618947547136)]} 0 0
   [junit4]   2> 309446 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[23 (1460207618950692864)]} 0 0
   [junit4]   2> 309449 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[23 (1460207618952790016)]} 0 1
   [junit4]   2> 309452 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[100 (1460207618955935744)]} 0 1
   [junit4]   2> 309454 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[100 (1460207618959081472)]} 0 0
   [junit4]   2> 309457 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[101 (1460207618962227200)]} 0 0
   [junit4]   2> 309460 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[101 (1460207618964324352)]} 0 1
   [junit4]   2> 309463 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[102 (1460207618967470080)]} 0 1
   [junit4]   2> 309465 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[102 (1460207618970615808)]} 0 1
   [junit4]   2> 309468 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[103 (1460207618972712960)]} 0 1
   [junit4]   2> 309471 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[103 (1460207618975858688)]} 0 1
   [junit4]   2> 309473 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[104 (1460207618979004416)]} 0 0
   [junit4]   2> 309476 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[104 (1460207618981101568)]} 0 1
   [junit4]   2> 309478 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[105 (1460207618984247296)]} 0 0
   [junit4]   2> 309481 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[105 (1460207618986344448)]} 0 1
   [junit4]   2> 309484 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[106 (1460207618989490176)]} 0 1
   [junit4]   2> 309486 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[106 (1460207618992635904)]} 0 0
   [junit4]   2> 309489 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[107 (1460207618994733056)]} 0 1
   [junit4]   2> 309493 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[107 (1460207618998927360)]} 0 1
   [junit4]   2> 309495 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[108 (1460207619002073088)]} 0 0
   [junit4]   2> 309499 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[108 (1460207619005218816)]} 0 1
   [junit4]   2> 309504 T1039 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[109 (1460207619009413120)]} 0 2
   [junit4]   2> 309507 T1054 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[109 (1460207619013607424)]} 0 1
   [junit4]   2> 309510 T1040 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[110 (1460207619016753152)]} 0 1
   [junit4]   2> 309513 T1051 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[110 (1460207619019898880)]} 0 1
   [junit4]   2> 309515 T1041 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[111 (1460207619023044608)]} 0 0
   [junit4]   2> 309518 T1052 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[111 (1460207619025141760)]} 0 1
   [junit4]   2> 309521 T1042 C1424 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabin&version=2} {add=[112 (1460207619028287488)]} 0 1
   [junit4]   2> 309523 T1053 C1425 oasup.LogUpdateProcessor.finish [collection1] webapp=/o_qr/p path=/update params={wt=javabi

[...truncated too long message...]

or.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DistribCursorPagingTest -Dtests.method=testDistribSearch -Dtests.seed=5403E38B5618D23A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja_JP_JP_#u-ca-japanese -Dtests.timezone=CST -Dtests.file.encoding=UTF-8
   [junit4] ERROR   22.5s J1 | DistribCursorPagingTest.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:33091/collection1, https://127.0.0.1:42235/collection1, https://127.0.0.1:60140/collection1]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([5403E38B5618D23A:D5E56D932147B206]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:362)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:635)
   [junit4]    > 	at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1356)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:563)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:532)
   [junit4]    > 	at org.apache.solr.cloud.DistribCursorPagingTest.doSimpleTest(DistribCursorPagingTest.java:257)
   [junit4]    > 	at org.apache.solr.cloud.DistribCursorPagingTest.doTest(DistribCursorPagingTest.java:89)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 500 Server Error</title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 500</h2>
   [junit4]    > <p>Problem accessing /collection1/select. Reason:
   [junit4]    > <pre>    Server Error</pre></p>
   [junit4]    > <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    >                                                 
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:459)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:293)
   [junit4]    > 	... 49 more
   [junit4]   2> 1070496 T4930 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ja_JP_JP_#u-ca-japanese, timezone=CST
   [junit4]   2> NOTE: Linux 3.8.0-35-generic i386/Oracle Corporation 1.8.0 (32-bit)/cpus=8,threads=1,free=101778576,total=236265472
   [junit4]   2> NOTE: All tests run in this JVM: [BasicZkTest, DistanceFunctionTest, MultiTermTest, TestMaxScoreQueryParser, TestSchemaResource, StatsComponentTest, DocValuesMultiTest, TestNonDefinedSimilarityFactory, TestPhraseSuggestions, BlockCacheTest, TestCollapseQParserPlugin, CurrencyFieldXmlFileTest, ChaosMonkeySafeLeaderTest, TestFieldTypeCollectionResource, NoCacheHeaderTest, DateFieldTest, OpenCloseCoreStressTest, NumericFieldsTest, TestRecovery, TestSolrQueryParserDefaultOperatorResource, TestFiltering, TestCollationField, UniqFieldsUpdateProcessorFactoryTest, SpellCheckComponentTest, RequiredFieldsTest, TestDFRSimilarityFactory, TestIndexSearcher, IndexBasedSpellCheckerTest, SolrTestCaseJ4Test, TestXIncludeConfig, ChaosMonkeyNothingIsSafeTest, TestUpdate, TestFreeTextSuggestions, CachingDirectoryFactoryTest, TestQueryTypes, TestDistributedGrouping, TestAtomicUpdateErrorCases, TestNoOpRegenerator, JSONWriterTest, ZkNodePropsTest, TestDefaultSimilarityFactory, SortByFunctionTest, TestManagedSchemaFieldResource, BJQParserTest, CursorMarkTest, TestDistributedSearch, DefaultValueUpdateProcessorTest, TestFastOutputStream, SpellCheckCollatorTest, DeleteShardTest, HardAutoCommitTest, SignatureUpdateProcessorFactoryTest, TestCoreDiscovery, TestFieldResource, PluginInfoTest, TestRecoveryHdfs, TestSolrCoreProperties, TestPartialUpdateDeduplication, TermVectorComponentDistributedTest, BasicDistributedZk2Test, TestCSVLoader, PreAnalyzedUpdateProcessorTest, SolrCmdDistributorTest, TestBinaryResponseWriter, TestUtils, SuggestComponentTest, RAMDirectoryFactoryTest, HighlighterConfigTest, SolrPluginUtilsTest, TestHighFrequencyDictionaryFactory, TestWordDelimiterFilterFactory, TestFuzzyAnalyzedSuggestions, PreAnalyzedFieldTest, AlternateDirectoryTest, LeaderElectionIntegrationTest, TestOverriddenPrefixQueryForCustomFieldType, HighlighterTest, OutputWriterTest, DistributedDebugComponentTest, HdfsBasicDistributedZk2Test, QueryResultKeyTest, SolrCoreCheckLockOnStartupTest, TestAddFieldRealTimeGet, TestJmxIntegration, PrimUtilsTest, TestFastLRUCache, SuggesterWFSTTest, XmlUpdateRequestHandlerTest, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, ZkSolrClientTest, ShardRoutingCustomTest, TestFaceting, TestHashPartitioner, TestMultiCoreConfBootstrap, TestReload, TestStressVersions, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, TestGroupingSearch, TestFunctionQuery, TestLazyCores, TestBadConfig, CurrencyFieldOpenExchangeTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SolrRequestParserTest, TestStressLucene, DirectUpdateHandlerOptimizeTest, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, FileBasedSpellCheckerTest, TestValueSourceCache, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, IndexSchemaTest, QueryParsingTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, CoreContainerCoreInitFailuresTest, SOLR749Test, TestQuerySenderNoQuery, ResponseLogComponentTest, TestStressRecovery, DirectSolrConnectionTest, TestLuceneMatchVersion, TestSweetSpotSimilarityFactory, TestNumberUtils, TestIBSimilarityFactory, TestJmxMonitoredMap, OpenExchangeRatesOrgProviderTest, DateMathParserTest, SpellingQueryConverterTest, TestSolrJ, TestLRUCache, FileUtilsTest, TestRTGBase, TestDistributedMissingSort, AssignTest, ConnectionManagerTest, CustomCollectionTest, DistribCursorPagingTest]
   [junit4] Completed on J1 in 22.53s, 1 test, 1 error <<< FAILURES!

[...truncated 161 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:459: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:439: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:491: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1308: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:941: There were test failures: 362 suites, 1563 tests, 5 errors, 35 ignored (7 assumptions)

Total time: 44 minutes 1 second
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure