You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/04/04 14:33:40 UTC

[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 5 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/5/

5 tests failed.
FAILED:  org.apache.solr.cloud.AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse

Error Message:
expected same:<COMPLETED> was not:<RUNNING>

Stack Trace:
java.lang.AssertionError: expected same:<COMPLETED> was not:<RUNNING>
	at __randomizedtesting.SeedInfo.seed([541CD923028B1CB:5F40A87E1E123C12]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotSame(Assert.java:641)
	at org.junit.Assert.assertSame(Assert.java:580)
	at org.junit.Assert.assertSame(Assert.java:593)
	at org.apache.solr.cloud.AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse(AsyncCallRequestStatusResponseTest.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
timed out waiting for collection1 startAt time to exceed: Mon Apr 04 13:35:05 CEST 2016

Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Mon Apr 04 13:35:05 CEST 2016
	at __randomizedtesting.SeedInfo.seed([541CD923028B1CB:DEEACD543500D878]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1422)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:774)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.spelling.suggest.SuggesterTest.testReload

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([541CD923028B1CB:C2B1B591FA6B49D9]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:775)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:742)
	at org.apache.solr.spelling.suggest.SuggesterTest.testReload(SuggesterTest.java:90)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//lst[@name='spellcheck']/lst[@name='suggestions']/lst[@name='ac']/int[@name='numFound'][.='2']
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1</int></lst><lst name="spellcheck"><lst name="suggestions"/><lst name="collations"/></lst>
</response>

	request was:q=ac&qt=/suggest&spellcheck.onlyMorePopular=true&spellcheck.count=2&wt=xml
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:768)
	... 41 more


FAILED:  org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete

Error Message:
Got a soft commit we weren't expecting

Stack Trace:
java.lang.AssertionError: Got a soft commit we weren't expecting
	at __randomizedtesting.SeedInfo.seed([541CD923028B1CB:C20D750F2B807C7B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeDelete(SoftAutoCommitTest.java:287)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
KeeperErrorCode = Session expired for /collections

Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:297)
	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:294)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:294)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:488)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:458)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:445)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:401)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode(CollectionsAPIDistributedZkTest.java:191)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:172)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11231 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/init-core-data-001
   [junit4]   2> 132711 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[541CD923028B1CB]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 132711 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[541CD923028B1CB]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 132719 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 132719 INFO  (Thread-923) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 132719 INFO  (Thread-923) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 132822 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.ZkTestServer start zk server on port:53209
   [junit4]   2> 132822 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 132850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 132870 INFO  (zkCallback-66-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@49b1f9e3 name:ZooKeeperConnection Watcher:127.0.0.1:53209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 132870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 132870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 132870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 132890 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 132906 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 132922 INFO  (zkCallback-67-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d7c216b name:ZooKeeperConnection Watcher:127.0.0.1:53209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 132922 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 132922 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 132922 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 132924 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 132927 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 132942 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 132944 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 133167 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 133169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 133169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 133170 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 133170 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 133172 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 133172 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 133174 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 133174 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 133177 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 133177 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 133180 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 133180 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 133183 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 133183 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 133185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 133185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 133188 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 133188 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 133191 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 133191 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 133199 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 133210 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 133221 INFO  (zkCallback-68-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c54197f name:ZooKeeperConnection Watcher:127.0.0.1:53209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133221 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 133221 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 133535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1
   [junit4]   2> 133578 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 133717 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c521373{/,null,AVAILABLE}
   [junit4]   2> 133737 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.u.s.SslContextFactory x509=X509@4ee98e87(solrtest,h=[],w=[]) for SslContextFactory@b378ca6(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 134216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@546d044a{SSL,[ssl, http/1.1]}{127.0.0.1:59902}
   [junit4]   2> 134216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.Server Started @140842ms
   [junit4]   2> 134216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/tempDir-001/control/data, hostContext=/, hostPort=59902, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores}
   [junit4]   2> 134217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 134217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001'
   [junit4]   2> 134217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 134217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 134217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 134230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 134270 INFO  (zkCallback-69-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@153c4f7 name:ZooKeeperConnection Watcher:127.0.0.1:53209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134270 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 134270 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 134299 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 134299 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/solr.xml
   [junit4]   2> 134324 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores
   [junit4]   2> 134324 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.CoreContainer New CoreContainer 2033010216
   [junit4]   2> 134324 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001]
   [junit4]   2> 134324 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/lib
   [junit4]   2> 134363 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 134366 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 134385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 134385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 134385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53209/solr
   [junit4]   2> 134385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 134385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 134408 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 134424 INFO  (zkCallback-72-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@670d0fa3 name:ZooKeeperConnection Watcher:127.0.0.1:53209 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134584 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 134584 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 134638 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 134666 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@284f297a name:ZooKeeperConnection Watcher:127.0.0.1:53209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134666 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 134687 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 134699 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 134716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 134717 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 134726 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 134727 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 134728 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 134728 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 134729 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 134729 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 134730 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 134731 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 134732 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 134740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 134740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95667267740696581-127.0.0.1:59902_-n_0000000000
   [junit4]   2> 134740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59902_
   [junit4]   2> 134740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 134742 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer Overseer (id=95667267740696581-127.0.0.1:59902_-n_0000000000) starting
   [junit4]   2> 134743 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 134747 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 134748 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 134749 INFO  (OverseerCollectionConfigSetProcessor-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 134758 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59902_
   [junit4]   2> 134758 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59902_
   [junit4]   2> 134759 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 134766 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 134766 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 134823 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 134823 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 134842 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores
   [junit4]   2> 134844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 134844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1
   [junit4]   2> 134844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 134854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 134854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [n:127.0.0.1:59902_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 134883 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 134883 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 134918 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 134922 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:59902",
   [junit4]   2>   "node_name":"127.0.0.1:59902_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 135053 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:59902",
   [junit4]   2>   "node_name":"127.0.0.1:59902_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 135061 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 135062 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 135064 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 136046 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 136046 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 136046 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 136046 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 136047 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 136047 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1'
   [junit4]   2> 136047 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 136047 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 136054 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 136060 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 136062 WARN  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 136063 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 136099 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 136113 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 136318 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 136323 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 136324 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 136340 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 136343 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 136344 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 136345 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 136347 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 136347 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 136348 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 136348 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data/]
   [junit4]   2> 136348 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79ce30f3
   [junit4]   2> 136348 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data
   [junit4]   2> 136349 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data/index/
   [junit4]   2> 136349 WARN  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 136349 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data/index
   [junit4]   2> 136349 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=2.1513671875, floorSegmentMB=0.3583984375, forceMergeDeletesPctAllowed=6.035769643204859, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.48500730862470076
   [junit4]   2> 136350 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@675ce7df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7daa134e),segFN=segments_1,generation=1}
   [junit4]   2> 136350 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 136355 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 136356 WARN  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 136381 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 136382 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 136382 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 136383 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 136383 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data/
   [junit4]   2> 136384 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 136404 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 136404 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 136406 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 136406 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 136407 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 136407 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 136407 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=4, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=0.5830078125, floorSegmentMB=1.9833984375, forceMergeDeletesPctAllowed=0.35322663352635675, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.28514553166934686
   [junit4]   2> 136414 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@675ce7df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7daa134e),segFN=segments_1,generation=1}
   [junit4]   2> 136414 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 136414 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@66e239ba[collection1] main]
   [junit4]   2> 136415 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 136415 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 136415 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 136416 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 136417 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 136417 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 136417 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 136417 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1530676287727730688
   [junit4]   2> 136418 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1530676287727730688
   [junit4]   2> 136418 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 136418 INFO  (searcherExecutor-216-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@66e239ba[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 136419 INFO  (coreLoadExecutor-215-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 136422 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:59902 collection:control_collection shard:shard1
   [junit4]   2> 136423 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 136431 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95667267740696581-core_node1-n_0000000000
   [junit4]   2> 136431 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 136432 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 136433 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 136433 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:59902/collection1/
   [junit4]   2> 136433 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 136433 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:59902/collection1/ has no replicas
   [junit4]   2> 136636 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 136642 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 136642 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95667267740696581-core_node1-n_0000000000
   [junit4]   2> 136662 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 136684 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:59902/collection1/ shard1
   [junit4]   2> 136705 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:59902",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 136816 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 136844 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:59902/collection1/ and leader is https://127.0.0.1:59902/collection1/
   [junit4]   2> 136845 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:59902
   [junit4]   2> 136845 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 136845 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 136845 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 136847 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:59902",
   [junit4]   2>   "node_name":"127.0.0.1:59902_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 136847 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:59902",
   [junit4]   2>   "node_name":"127.0.0.1:59902_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 136848 INFO  (coreZkRegister-209-thread-1-processing-n:127.0.0.1:59902_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59902_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 136865 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 136873 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 137007 INFO  (zkCallback-73-thread-1-processing-n:127.0.0.1:59902_) [n:127.0.0.1:59902_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 137019 INFO  (zkCallback-75-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@207c5908 name:ZooKeeperConnection Watcher:127.0.0.1:53209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 137019 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 137019 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 137019 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 137034 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 137042 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 137042 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 137042 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 137074 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 137082 INFO  (zkCallback-76-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22776299 name:ZooKeeperConnection Watcher:127.0.0.1:53209/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 137082 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 137082 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 137087 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 4
   [junit4]   2> 137087 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 137189 INFO  (OverseerStateUpdate-95667267740696581-127.0.0.1:59902_-n_0000000000) [n:127.0.0.1:59902_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 137281 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/shard-1-001/cores/collection1
   [junit4]   2> 137284 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/shard-1-001
   [junit4]   2> 137288 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 137290 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c731fc8{/,null,AVAILABLE}
   [junit4]   2> 137293 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.u.s.SslContextFactory x509=X509@7d318571(solrtest,h=[],w=[]) for SslContextFactory@172243d0(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1dd73e45{SSL,[ssl, http/1.1]}{127.0.0.1:36089}
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.e.j.s.Server Started @143923ms
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=36089, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/shard-1-001/cores}
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_541CD923028B1CB-001/shard-1-001'
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 137297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[541CD923028B1CB]) [    ] o.a.s.c.SolrResourc

[...truncated too long message...]

O  (commitScheduler-8758-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3971649 INFO  (searcherExecutor-8755-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@54baf5a1[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c5) Uninverting(_2(6.0.0):c1) Uninverting(_3(6.0.0):c1) Uninverting(_4(6.0.0):c1)))}
   [junit4]   2> 3971738 INFO  (commitScheduler-8757-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 3971742 INFO  (commitScheduler-8757-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c0f058b),segFN=segments_4,generation=4}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c0f058b),segFN=segments_5,generation=5}
   [junit4]   2> 3971742 INFO  (commitScheduler-8757-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 5
   [junit4]   2> 3971742 INFO  (commitScheduler-8757-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3988b7c5[collection1] main]
   [junit4]   2> 3971742 INFO  (commitScheduler-8757-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 3971743 INFO  (searcherExecutor-8755-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3988b7c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c5) Uninverting(_2(6.0.0):c1) Uninverting(_3(6.0.0):c1) Uninverting(_4(6.0.0):c1)))}
   [junit4]   2> 3974964 INFO  (TEST-SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds-seed#[541CD923028B1CB]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testSoftAndHardCommitMaxTimeMixedAdds
   [junit4]   2> 3974964 INFO  (SUITE-SoftAutoCommitTest-seed#[541CD923028B1CB]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 3974964 INFO  (SUITE-SoftAutoCommitTest-seed#[541CD923028B1CB]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=701030277
   [junit4]   2> 3974965 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@232ebd20
   [junit4]   2> 3974965 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=3,autocommit maxTime=1200ms,autocommits=1,soft autocommit maxTime=500ms,soft autocommits=2,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=769,transaction_logs_total_number=3}
   [junit4]   2> 3974965 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 3974965 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 3974965 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 3974973 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 3974989 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 3974989 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 3974989 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/init-core-data-001/index
   [junit4]   2> 3974989 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/init-core-data-001;done=false>>]
   [junit4]   2> 3974989 INFO  (coreCloseExecutor-8759-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001/init-core-data-001
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.update.SoftAutoCommitTest_541CD923028B1CB-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {range_facet_l_dv=FSTOrd50, _version_=PostingsFormat(name=Memory doPackFST= true), multiDefault=PostingsFormat(name=LuceneFixedGap), subject=PostingsFormat(name=LuceneFixedGap), intDefault=PostingsFormat(name=Memory doPackFST= true), id=FSTOrd50, range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), text=Lucene50(blocksize=128), range_facet_l=PostingsFormat(name=LuceneFixedGap), timestamp=PostingsFormat(name=LuceneFixedGap)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=255, maxMBSortInHeap=4.184426959280635, sim=ClassicSimilarity, locale=ar-AE, timezone=Australia/NSW
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=192641192,total=522715136
   [junit4]   2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, BlockCacheTest, SimplePostToolTest, DirectSolrSpellCheckerTest, ZkStateReaderTest, TermVectorComponentTest, TestDistributedGrouping, MultiTermTest, HLLUtilTest, ShardRoutingCustomTest, TestQuerySenderListener, TestOrdValues, CollectionsAPIDistributedZkTest, TestManagedSchema, ExplicitHLLTest, ChaosMonkeyNothingIsSafeTest, TestLMJelinekMercerSimilarityFactory, OpenCloseCoreStressTest, MinimalSchemaTest, HdfsRecoveryZkTest, MigrateRouteKeyTest, TestNRTOpen, TestCustomDocTransformer, TestDocumentBuilder, RollingRestartTest, SolrPluginUtilsTest, TestFieldResource, AsyncMigrateRouteKeyTest, NumericFieldsTest, IndexBasedSpellCheckerTest, ConjunctionSolrSpellCheckerTest, TestRTimerTree, TermsComponentTest, HdfsCollectionsAPIDistributedZkTest, TestPartialUpdateDeduplication, DocValuesTest, QueryResultKeyTest, CdcrReplicationHandlerTest, TestQueryUtils, TestTrie, HdfsThreadLeakTest, TestAuthenticationFramework, TestManagedSynonymFilterFactory, PKIAuthenticationIntegrationTest, OpenExchangeRatesOrgProviderTest, SuggestComponentContextFilterQueryTest, SoftAutoCommitTest]
   [junit4] Completed [351/579 (5!)] on J1 in 9.91s, 3 tests, 1 failure <<< FAILURES!

[...truncated 750 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 2 errors, 3 failures, 31 ignored (16 assumptions) [seed: 541CD923028B1CB]

Total time: 293 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 21 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/21/

1 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=53919, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=53919, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53323, http://127.0.0.1:60769, http://127.0.0.1:49907, http://127.0.0.1:38303, http://127.0.0.1:38744]
	at __randomizedtesting.SeedInfo.seed([25DEEA7E1DC473DD]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:1000)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53323, http://127.0.0.1:60769, http://127.0.0.1:49907, http://127.0.0.1:38303, http://127.0.0.1:38744]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49907: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 5 more




Build Log:
[...truncated 12566 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/init-core-data-001
   [junit4]   2> 5223634 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 5223635 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 5223661 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 5223676 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 5223677 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 5223686 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_41736_hdfs____4pp1pj/webapp
   [junit4]   2> 5223766 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 5224051 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41736
   [junit4]   2> 5224099 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 5224100 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 5224108 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_38958_datanode____.41xb42/webapp
   [junit4]   2> 5224185 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 5224493 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38958
   [junit4]   2> 5224575 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 5224577 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 5224590 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_33926_datanode____1x45dw/webapp
   [junit4]   2> 5224622 INFO  (IPC Server handler 7 on 38955) [    ] BlockStateChange BLOCK* processReport: from storage DS-85e16d71-55e3-4e5a-85b6-5d8a006e5b41 node DatanodeRegistration(127.0.0.1, datanodeUuid=6b6790ae-c1d8-4b76-b96d-b954b1384e56, infoPort=38958, ipcPort=36015, storageInfo=lv=-56;cid=testClusterID;nsid=1981677780;c=0), blocks: 0, hasStaleStorages: true, processing time: 2 msecs
   [junit4]   2> 5224622 INFO  (IPC Server handler 7 on 38955) [    ] BlockStateChange BLOCK* processReport: from storage DS-cab43e21-6d45-4cdd-8c4c-9f036a654ac0 node DatanodeRegistration(127.0.0.1, datanodeUuid=6b6790ae-c1d8-4b76-b96d-b954b1384e56, infoPort=38958, ipcPort=36015, storageInfo=lv=-56;cid=testClusterID;nsid=1981677780;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 5224686 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 5225000 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[25DEEA7E1DC473DD]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33926
   [junit4]   2> 5225069 INFO  (IPC Server handler 8 on 38955) [    ] BlockStateChange BLOCK* processReport: from storage DS-9983d900-3cbd-4246-a6ae-056b2f56849b node DatanodeRegistration(127.0.0.1, datanodeUuid=f579fb41-7252-4f5c-8a08-9b12328b8479, infoPort=33926, ipcPort=34612, storageInfo=lv=-56;cid=testClusterID;nsid=1981677780;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 5225069 INFO  (IPC Server handler 8 on 38955) [    ] BlockStateChange BLOCK* processReport: from storage DS-d0e3cd2f-2917-48ab-9bc5-440ddff37a15 node DatanodeRegistration(127.0.0.1, datanodeUuid=f579fb41-7252-4f5c-8a08-9b12328b8479, infoPort=33926, ipcPort=34612, storageInfo=lv=-56;cid=testClusterID;nsid=1981677780;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 5225163 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 5225163 INFO  (Thread-31141) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 5225163 INFO  (Thread-31141) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 5225263 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ZkTestServer start zk server on port:51333
   [junit4]   2> 5225263 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5225264 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5225266 INFO  (zkCallback-5098-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@125a21ca name:ZooKeeperConnection Watcher:127.0.0.1:51333 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5225266 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5225267 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5225267 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 5225270 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5225270 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5225271 INFO  (zkCallback-5099-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bd2e9fe name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5225271 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5225271 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5225271 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 5225273 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 5225274 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 5225275 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 5225276 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 5225276 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 5225277 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 5225277 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 5225278 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 5225278 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 5225279 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 5225279 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 5225280 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 5225280 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 5225281 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 5225281 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 5225282 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 5225282 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 5225283 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 5225283 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 5225284 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 5225284 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 5225285 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 5225285 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 5225286 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 5225286 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 5225345 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores/collection1
   [junit4]   2> 5225346 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@76ee5f37{/,null,AVAILABLE}
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.ServerConnector Started ServerConnector@64f44002{HTTP/1.1,[http/1.1]}{127.0.0.1:38303}
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.Server Started @5228350ms
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:38955/hdfs__localhost_38955__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001_tempDir-002_control_data, hostContext=/, hostPort=38303, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores}
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001'
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 5225348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 5225349 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5225349 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5225350 INFO  (zkCallback-5100-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ddd4b4d name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5225351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5225351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5225351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 5225352 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/solr.xml
   [junit4]   2> 5225356 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores
   [junit4]   2> 5225356 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CoreContainer New CoreContainer 1307910517
   [junit4]   2> 5225356 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001]
   [junit4]   2> 5225356 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/lib
   [junit4]   2> 5225356 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 5225357 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 5225357 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 5225357 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 5225358 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51333/solr
   [junit4]   2> 5225358 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 5225358 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5225358 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5225359 INFO  (zkCallback-5103-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c13fce1 name:ZooKeeperConnection Watcher:127.0.0.1:51333 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5225359 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5225359 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5225360 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$29/699737714@3b62099f
   [junit4]   2> 5225360 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5225361 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cc4cb2 name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5225361 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5225362 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 5225363 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 5225364 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 5225365 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 5225366 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 5225367 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 5225368 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 5225368 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 5225369 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 5225369 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 5225370 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 5225371 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 5225372 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 5225372 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 5225372 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95966359574478852-127.0.0.1:38303_-n_0000000000
   [junit4]   2> 5225373 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38303_
   [junit4]   2> 5225373 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 5225373 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer Overseer (id=95966359574478852-127.0.0.1:38303_-n_0000000000) starting
   [junit4]   2> 5225374 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 5225377 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 5225377 INFO  (OverseerCollectionConfigSetProcessor-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 5225378 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38303_
   [junit4]   2> 5225378 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 5225379 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38303_
   [junit4]   2> 5225380 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 5225380 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 5225380 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 5225394 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 5225394 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 5225394 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores
   [junit4]   2> 5225395 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 5225395 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores/collection1
   [junit4]   2> 5225395 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 5225395 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 5225395 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38303_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 5225396 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 5225396 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 5225396 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
   [junit4]   2> 5225397 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38303",
   [junit4]   2>   "node_name":"127.0.0.1:38303_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 5225397 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [control_collection]
   [junit4]   2> 5225397 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38303",
   [junit4]   2>   "node_name":"127.0.0.1:38303_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 5225397 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 5225397 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 5225397 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 5225398 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 5225398 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5226399 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 5226399 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 5226399 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 5226399 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 5226399 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 5226400 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores/collection1'
   [junit4]   2> 5226400 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 5226400 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 5226401 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 5226404 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 5226421 WARN  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 5226422 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 5226428 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 5226432 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 5226499 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 5226503 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 5226504 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 5226518 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 5226519 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 5226520 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 5226521 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:38955/solr_hdfs_home
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/control-001/cores/collection1], dataDir=[hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fc99d50
   [junit4]   2> 5226522 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 5226531 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 5226531 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 5226536 WARN  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:38955/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 5226536 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 5226543 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 5226543 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=8, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4017898308290171]
   [junit4]   2> 5226555 INFO  (IPC Server handler 3 on 38955) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36493 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-cab43e21-6d45-4cdd-8c4c-9f036a654ac0:NORMAL:127.0.0.1:54056|RBW], ReplicaUnderConstruction[[DISK]DS-9983d900-3cbd-4246-a6ae-056b2f56849b:NORMAL:127.0.0.1:36493|RBW]]} size 0
   [junit4]   2> 5226556 INFO  (IPC Server handler 4 on 38955) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:54056 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9983d900-3cbd-4246-a6ae-056b2f56849b:NORMAL:127.0.0.1:36493|RBW], ReplicaUnderConstruction[[DISK]DS-85e16d71-55e3-4e5a-85b6-5d8a006e5b41:NORMAL:127.0.0.1:54056|FINALIZED]]} size 0
   [junit4]   2> 5226557 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ef182b3; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 5226557 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 5226558 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 5226559 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 5226560 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 5226560 WARN  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 5226562 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 5226562 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 5226563 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 5226563 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 5226565 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 5226565 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 5226565 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 5226565 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 5226566 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 5226571 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 5226572 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 5226572 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=15, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.35225842121746487]
   [junit4]   2> 5226575 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@hdfs://localhost:38955/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ef182b3; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 5226575 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 5226575 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5209ee84[collection1] main]
   [junit4]   2> 5226575 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 5226575 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 5226575 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 5226576 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 5226577 INFO  (searcherExecutor-13025-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5209ee84[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 5226577 WARN  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Could not retrieve locality information for hdfs://localhost:59745/solr3 due to exception: java.net.ConnectException: Call From lucene1-us-west/10.41.0.5 to localhost:59745 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
   [junit4]   2> 5226577 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 5226577 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 5226577 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 5226577 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1535461754673299456
   [junit4]   2> 5226579 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1535461754673299456
   [junit4]   2> 5226579 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 5226580 INFO  (coreLoadExecutor-13024-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 5226580 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:38303 collection:control_collection shard:shard1
   [junit4]   2> 5226580 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 5226582 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95966359574478852-core_node1-n_0000000000
   [junit4]   2> 5226582 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 5226583 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 5226583 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 5226583 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 5226583 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38303/collection1/
   [junit4]   2> 5226584 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 5226584 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:38303/collection1/ has no replicas
   [junit4]   2> 5226584 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 5226585 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95966359574478852-core_node1-n_0000000000
   [junit4]   2> 5226586 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38303/collection1/ shard1
   [junit4]   2> 5226587 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:38303",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 5226688 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5226737 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:38303/collection1/ and leader is http://127.0.0.1:38303/collection1/
   [junit4]   2> 5226737 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38303
   [junit4]   2> 5226737 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 5226737 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 5226737 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 5226738 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38303",
   [junit4]   2>   "node_name":"127.0.0.1:38303_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 5226739 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38303",
   [junit4]   2>   "node_name":"127.0.0.1:38303_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 5226739 INFO  (coreZkRegister-13018-thread-1-processing-n:127.0.0.1:38303_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38303_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 5226840 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5226897 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5226897 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5226898 INFO  (zkCallback-5106-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3db1e460 name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5226898 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5226898 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5226898 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 5226899 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 5226899 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 5226899 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 5226899 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5226900 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5226900 INFO  (zkCallback-5107-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3e5c774d name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5226900 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5226901 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5226902 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 5226902 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 5226968 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/cores/collection1
   [junit4]   2> 5226968 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001
   [junit4]   2> 5226969 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 5226970 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ea27c65{/,null,AVAILABLE}
   [junit4]   2> 5226970 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.ServerConnector Started ServerConnector@77aad4de{HTTP/1.1,[http/1.1]}{127.0.0.1:38744}
   [junit4]   2> 5226971 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.e.j.s.Server Started @5229973ms
   [junit4]   2> 5226971 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:38955/hdfs__localhost_38955__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=38744, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/cores}
   [junit4]   2> 5226972 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 5226972 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001'
   [junit4]   2> 5226972 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 5226972 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 5226972 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5226972 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5226973 INFO  (zkCallback-5108-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d83d9f8 name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5226973 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5226973 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5226974 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 5226974 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/solr.xml
   [junit4]   2> 5226977 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/cores
   [junit4]   2> 5226977 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CoreContainer New CoreContainer 221405923
   [junit4]   2> 5226977 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001]
   [junit4]   2> 5226977 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/lib
   [junit4]   2> 5226978 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 5226978 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 5226979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 5226979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 5226979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51333/solr
   [junit4]   2> 5226979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 5226979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 5226979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5226980 INFO  (zkCallback-5111-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@469cfc20 name:ZooKeeperConnection Watcher:127.0.0.1:51333 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5226980 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5226980 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 5226981 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$29/699737714@662b0f2c
   [junit4]   2> 5226981 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 5226981 INFO  (zkCallback-5112-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b85a981 name:ZooKeeperConnection Watcher:127.0.0.1:51333/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 5226981 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 5226984 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 5226985 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 5226986 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 5226986 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95966359574478857-127.0.0.1:38744_-n_0000000001
   [junit4]   2> 5226987 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95966359574478852-127.0.0.1:38303_-n_0000000000 to know if I could be the leader
   [junit4]   2> 5226987 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.ZkController Publish node=127.0.0.1:38744_ as DOWN
   [junit4]   2> 5226988 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:38744_"} current state version: 3
   [junit4]   2> 5226988 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:38744_
   [junit4]   2> 5226988 INFO  (OverseerStateUpdate-95966359574478852-127.0.0.1:38303_-n_0000000000) [n:127.0.0.1:38303_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 5227090 INFO  (zkCallback-5106-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5227091 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5227091 INFO  (zkCallback-5112-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5227988 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38744_
   [junit4]   2> 5227988 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38744_
   [junit4]   2> 5227989 INFO  (zkCallback-5106-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5227989 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5227989 INFO  (zkCallback-5106-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 5227992 INFO  (zkCallback-5112-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5227994 INFO  (zkCallback-5104-thread-1-processing-n:127.0.0.1:38303_) [n:127.0.0.1:38303_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 5227995 INFO  (zkCallback-5112-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 5227996 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 5227996 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 5227997 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/cores
   [junit4]   2> 5227997 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 5227997 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_25DEEA7E1DC473DD-001/shard-1-001/cores/collection1
   [junit4]   2> 5227997 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 5227998 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 5227998 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[25DEEA7E1DC473DD]) [n:127.0.0.1:38744_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 5227998 INFO  (coreLoadExecutor-13035-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 5227998 INFO  (coreLoadExecutor-13035-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 5227999 INFO  (coreLoadExecutor-13035-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_ c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 5227999 INFO  (coreLoadExecutor-13035-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
   [junit4]   2> 5227999 INFO  (coreLoadExecutor-13035-thread-1-processing-n:127.0.0.1:38744_) [n:127.0.0.1:38744_ c:collection1   x:c

[...truncated too long message...]

ction1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:44096/collection1/] and I am [http://127.0.0.1:57695/collection1/]
   [junit4]   2> 8792852 INFO  (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkController publishing state=recovering
   [junit4]   2> 8792853 INFO  (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 8792853 WARN  (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkController Unable to read /collections/collection1/leader_initiated_recovery/shard1/core_node4 due to: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_initiated_recovery/shard1/core_node4
   [junit4]   2> 8792853 ERROR (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Error while trying to recover. core=collection1:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:383)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:380)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:380)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:248)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.publish(ZkController.java:1185)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.publish(ZkController.java:1097)
   [junit4]   2> 	at org.apache.solr.cloud.ZkController.publish(ZkController.java:1093)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:336)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:224)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 8792853 INFO  (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Replay not started, or was not successful... still buffering updates.
   [junit4]   2> 8792853 ERROR (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Recovery failed - trying again... (104)
   [junit4]   2> 8792854 INFO  (recoveryExecutor-1328-thread-13-processing-n:127.0.0.1:57695_ x:collection1 s:shard1 c:collection1 r:core_node4) [n:127.0.0.1:57695_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.RecoveryStrategy Wait [12.0] seconds before trying to recover again (attempt=105)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=Lucene50(blocksize=128), multiDefault=PostingsFormat(name=Asserting), a_t=Lucene50(blocksize=128), intDefault=Lucene50(blocksize=128), a_i1=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=Lucene50(blocksize=128), text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l=Lucene50(blocksize=128), timestamp=Lucene50(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=1629, maxMBSortInHeap=5.761549454592406, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=el-CY, timezone=Asia/Pyongyang
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=227,free=15299080,total=516423680
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedFacetPivotLongTailTest, DeleteShardTest, FieldAnalysisRequestHandlerTest, TestWriterPerf, SolrTestCaseJ4Test, BaseCdcrDistributedZkTest, TestSearcherReuse, HdfsThreadLeakTest, TestSolrJ, OverseerStatusTest, TestBlendedInfixSuggestions, BlockJoinFacetSimpleTest, TestManagedSchema, TestTestInjection, CurrencyFieldXmlFileTest, TestIndexSearcher, DirectSolrConnectionTest, TestSuggestSpellingConverter, TestManagedSynonymFilterFactory, TriLevelCompositeIdRoutingTest, TestReload, TestElisionMultitermQuery, SuggestComponentContextFilterQueryTest, DirectUpdateHandlerTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, TestIndexingPerformance, StatelessScriptUpdateProcessorFactoryTest, CircularListTest, TestReplicaProperties, AnalyticsQueryTest, RuleEngineTest, TestHighFrequencyDictionaryFactory, UpdateParamsTest, TestSort, TestCharFilters, ShowFileRequestHandlerTest, TestReRankQParserPlugin, TestDistribDocBasedVersion, FullSolrCloudDistribCmdsTest, PluginInfoTest, HLLSerializationTest, HighlighterConfigTest, TestSearchPerf, TestZkChroot, TermVectorComponentDistributedTest, TestMinMaxOnMultiValuedField, SolrCoreCheckLockOnStartupTest, TestExactSharedStatsCache, QueryResultKeyTest, TestJmxIntegration, TestCSVResponseWriter, TestCustomSort, TestUseDocValuesAsStored, TestSSLRandomization, ScriptEngineTest, JavabinLoaderTest, DeleteInactiveReplicaTest, HdfsWriteToMultipleCollectionsTest, SimpleFacetsTest, DistribDocExpirationUpdateProcessorTest, RequestHandlersTest, InfoHandlerTest, TestSolrQueryParserResource, SuggesterTSTTest, RegexBoostProcessorTest, TestRecovery, SampleTest, TestReversedWildcardFilterFactory, DistributedVersionInfoTest, TestExtendedDismaxParser, TestExpandComponent, TestCoreDiscovery, TestSolrQueryResponse, TestMissingGroups, TestReplicationHandlerBackup, TestSchemaVersionResource, TestCustomDocTransformer, SliceStateTest, TestSolrDeletionPolicy1, TestNonDefinedSimilarityFactory, ConnectionManagerTest, AssignTest, SimpleMLTQParserTest, TestPHPSerializedResponseWriter, TestDynamicFieldCollectionResource, CoreAdminCreateDiscoverTest, SuggesterTest, QueryParsingTest, BadIndexSchemaTest, HdfsBasicDistributedZkTest, TestSQLHandler, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] ERROR   0.00s J2 | CollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
   [junit4] Completed [584/584 (2!)] on J2 in 7204.26s, 1 test, 1 error <<< FAILURES!

[...truncated 2 lines...]
   [junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/temp/junit4-J2-20160527_050009_639.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/heapdumps/java_pid28980.hprof ...
   [junit4] Heap dump file created [725323722 bytes in 16.623 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 11 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2340 tests, 1 suite-level error, 1 error, 31 ignored (16 assumptions) [seed: 25DEEA7E1DC473DD]

Total time: 275 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 20 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/20/

4 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=116272, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=116272, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46875: collection already exists: awholynewstresscollection_collection0_3
	at __randomizedtesting.SeedInfo.seed([33FD9B2EC1BC674F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1616)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:990)


FAILED:  org.apache.solr.core.TestDynamicLoading.testDynamicLoading

Error Message:
Could not find collection:.system

Stack Trace:
java.lang.AssertionError: Could not find collection:.system
	at __randomizedtesting.SeedInfo.seed([33FD9B2EC1BC674F:EBB0B6793661C2EF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:151)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:130)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:852)
	at org.apache.solr.core.TestDynamicLoading.testDynamicLoading(TestDynamicLoading.java:116)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 4 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 4 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([33FD9B2EC1BC674F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([33FD9B2EC1BC674F:4C632CABA8DE4AC5]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:129)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay(ZkStateReaderTest.java:52)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11359 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_33FD9B2EC1BC674F-001/init-core-data-001
   [junit4]   2> 1213177 INFO  (SUITE-ZkStateReaderTest-seed#[33FD9B2EC1BC674F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1213180 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 1213180 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1213180 INFO  (Thread-3370) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1213180 INFO  (Thread-3370) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1213280 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:51583
   [junit4]   2> 1213280 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213281 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213282 INFO  (zkCallback-763-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b5f5d1a name:ZooKeeperConnection Watcher:127.0.0.1:51583 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213282 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213282 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213283 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213283 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213284 INFO  (zkCallback-764-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@64b5e1b3 name:ZooKeeperConnection Watcher:127.0.0.1:51583 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213284 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213284 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213284 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1213287 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213287 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213287 INFO  (zkCallback-765-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70d39551 name:ZooKeeperConnection Watcher:127.0.0.1:51583/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213287 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213287 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213288 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1213288 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1213289 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1213289 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1213290 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1213290 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1213291 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1213291 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1213292 INFO  (zkCallback-765-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1213292 INFO  (zkCallback-765-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1213293 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1213293 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1213294 INFO  (zkCallback-765-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1213294 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1213295 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51583 51583
   [junit4]   2> 1213407 INFO  (Thread-3370) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51583 51583
   [junit4]   2> 1213407 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 1213410 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 1213410 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1213410 INFO  (Thread-3371) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1213410 INFO  (Thread-3371) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1213510 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:49915
   [junit4]   2> 1213510 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213511 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213512 INFO  (zkCallback-766-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ed106da name:ZooKeeperConnection Watcher:127.0.0.1:49915 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213512 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213512 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213513 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213513 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x154ee8f90920000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1213513 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213519 INFO  (zkCallback-767-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@262d597c name:ZooKeeperConnection Watcher:127.0.0.1:49915 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213519 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213519 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213519 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1213521 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213521 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x154ee8f90920001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1213521 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213521 INFO  (zkCallback-768-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a8ce667 name:ZooKeeperConnection Watcher:127.0.0.1:49915/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213522 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213522 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213522 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1213523 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1213523 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1213524 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1213524 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1213525 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1213525 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1213526 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1213526 INFO  (zkCallback-768-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1213527 INFO  (zkCallback-768-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1213578 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1213578 INFO  (zkCallback-768-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1213630 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49915 49915
   [junit4]   2> 1213781 INFO  (Thread-3371) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49915 49915
   [junit4]   2> 1213781 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 1213783 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 1213784 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1213784 INFO  (Thread-3372) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1213784 INFO  (Thread-3372) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1213884 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:40397
   [junit4]   2> 1213884 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213884 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213885 INFO  (zkCallback-769-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@499f038f name:ZooKeeperConnection Watcher:127.0.0.1:40397 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213885 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213885 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213886 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213886 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213887 INFO  (zkCallback-770-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e683026 name:ZooKeeperConnection Watcher:127.0.0.1:40397 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213887 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213887 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213887 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1213888 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1213889 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1213889 INFO  (zkCallback-771-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f7c69d3 name:ZooKeeperConnection Watcher:127.0.0.1:40397/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1213889 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1213889 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1213889 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1213890 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1213891 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1213891 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1213892 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1213892 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1213893 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1213893 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1213894 INFO  (zkCallback-771-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1213894 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1213895 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1213895 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1213895 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1213895 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 1213896 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40397 40397
   [junit4]   2> 1214033 INFO  (Thread-3372) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40397 40397
   [junit4]   2> 1214033 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 1214036 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 1214036 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1214036 INFO  (Thread-3373) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1214036 INFO  (Thread-3373) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1214136 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:49702
   [junit4]   2> 1214136 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214136 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214138 INFO  (zkCallback-772-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@20920d46 name:ZooKeeperConnection Watcher:127.0.0.1:49702 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214138 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214138 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214138 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214139 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214142 INFO  (zkCallback-773-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7e9282ac name:ZooKeeperConnection Watcher:127.0.0.1:49702 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214142 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214142 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214142 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1214143 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214144 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214144 INFO  (zkCallback-774-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@193881c0 name:ZooKeeperConnection Watcher:127.0.0.1:49702/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214144 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214144 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214145 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1214145 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1214146 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1214146 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1214147 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1214147 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1214148 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1214148 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1214148 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1214148 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1214149 INFO  (zkCallback-774-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1214150 INFO  (zkCallback-774-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214150 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1214151 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1214151 INFO  (zkCallback-774-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214151 INFO  (zkCallback-774-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214151 INFO  (zkCallback-774-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1214152 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1214153 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49702 49702
   [junit4]   2> 1214278 INFO  (Thread-3373) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49702 49702
   [junit4]   2> 1214279 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 1214281 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 1214281 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1214282 INFO  (Thread-3374) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1214282 INFO  (Thread-3374) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1214382 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:36729
   [junit4]   2> 1214382 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214382 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214383 INFO  (zkCallback-775-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@49f8a68e name:ZooKeeperConnection Watcher:127.0.0.1:36729 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214383 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214383 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214384 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214384 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214388 INFO  (zkCallback-776-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39a2f0f9 name:ZooKeeperConnection Watcher:127.0.0.1:36729 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214388 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214388 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214389 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1214390 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214392 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214392 INFO  (zkCallback-777-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@192eec41 name:ZooKeeperConnection Watcher:127.0.0.1:36729/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214392 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214393 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214393 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1214393 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1214394 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1214395 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1214395 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1214395 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1214396 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1214396 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1214397 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1214397 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1214397 INFO  (zkCallback-777-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1214404 INFO  (zkCallback-777-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214455 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1214455 INFO  (zkCallback-777-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214455 INFO  (zkCallback-777-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214455 INFO  (zkCallback-777-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1214456 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36729 36729
   [junit4]   2> 1214615 INFO  (Thread-3374) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36729 36729
   [junit4]   2> 1214618 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithTimeDelay -Dtests.seed=33FD9B2EC1BC674F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=de-GR -Dtests.timezone=America/Coral_Harbour -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.35s J2 | ZkStateReaderTest.testStateFormatUpdateWithTimeDelay <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([33FD9B2EC1BC674F:4C632CABA8DE4AC5]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:129)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay(ZkStateReaderTest.java:52)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1214632 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWatchedCollectionCreation
   [junit4]   2> 1214633 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1214633 INFO  (Thread-3375) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1214633 INFO  (Thread-3375) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1214733 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:39324
   [junit4]   2> 1214733 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214733 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214735 INFO  (zkCallback-778-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18b83e6 name:ZooKeeperConnection Watcher:127.0.0.1:39324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214735 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214735 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214744 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214744 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214746 INFO  (zkCallback-779-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d37f753 name:ZooKeeperConnection Watcher:127.0.0.1:39324 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214746 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214746 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214746 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1214753 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1214756 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1214768 INFO  (zkCallback-780-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@71d057cf name:ZooKeeperConnection Watcher:127.0.0.1:39324/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1214768 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1214769 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1214769 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1214769 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1214769 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1214770 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1214770 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1214770 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1214771 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1214771 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1214771 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1214771 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1214772 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1214772 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1214772 INFO  (zkCallback-780-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1214776 INFO  (zkCallback-780-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1214777 INFO  (zkCallback-780-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1214828 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39324 39324
   [junit4]   2> 1214952 INFO  (Thread-3375) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39324 39324
   [junit4]   2> 1214953 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWatchedCollectionCreation
   [junit4]   2> 1214954 INFO  (SUITE-ZkStateReaderTest-seed#[33FD9B2EC1BC674F]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_33FD9B2EC1BC674F-001
   [junit4]   2> May 26, 2016 7:34:28 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1888, maxMBSortInHeap=6.746620272315982, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=de-GR, timezone=America/Coral_Harbour
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=136861040,total=524812288
   [junit4]   2> NOTE: All tests run in this JVM: [ShardSplitTest, HighlighterConfigTest, UpdateParamsTest, SimpleMLTQParserTest, FieldAnalysisRequestHandlerTest, BinaryUpdateRequestHandlerTest, TestPerFieldSimilarity, NoCacheHeaderTest, TestWriterPerf, DeleteShardTest, TestGroupingSearch, TestAuthenticationFramework, ConnectionManagerTest, TestSolrQueryParserResource, TestReplicationHandlerBackup, JavabinLoaderTest, DirectSolrConnectionTest, BasicDistributedZk2Test, TestZkChroot, LeaderFailoverAfterPartitionTest, TestSchemaNameResource, DistributedDebugComponentTest, DistribDocExpirationUpdateProcessorTest, TestPKIAuthenticationPlugin, FieldMutatingUpdateProcessorTest, TestExactSharedStatsCache, SearchHandlerTest, TestExpandComponent, TestNonDefinedSimilarityFactory, CheckHdfsIndexTest, TestHashQParserPlugin, TestSweetSpotSimilarityFactory, HdfsThreadLeakTest, TestSchemaVersionResource, PluginInfoTest, TestSolrQueryParser, ZkStateReaderTest]
   [junit4] Completed [128/584 (1!)] on J2 in 2.55s, 6 tests, 1 error <<< FAILURES!

[...truncated 491 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/init-core-data-001
   [junit4]   2> 1841127 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[33FD9B2EC1BC674F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1841128 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[33FD9B2EC1BC674F]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1841130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1841130 INFO  (Thread-7166) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1841130 INFO  (Thread-7166) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1841230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkTestServer start zk server on port:38204
   [junit4]   2> 1841231 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1841231 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1841233 INFO  (zkCallback-29514-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@537be770 name:ZooKeeperConnection Watcher:127.0.0.1:38204 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1841233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1841233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1841234 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1841235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1841236 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1841237 INFO  (zkCallback-29515-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2c6a026a name:ZooKeeperConnection Watcher:127.0.0.1:38204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1841237 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1841238 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1841238 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1841239 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1841240 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1841240 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1841241 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1841242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1841245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1841246 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1841247 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1841247 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1841250 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1841251 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1841252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1841252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1841253 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1841253 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1841255 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1841255 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1841256 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1841257 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1841258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1841259 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1841260 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1841260 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1841269 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1841270 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1841381 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/cores/collection1
   [junit4]   2> 1841382 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1841389 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@30055396{/,null,AVAILABLE}
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@21d92afd{HTTP/1.1,[http/1.1]}{127.0.0.1:54049}
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.e.j.s.Server Started @1844217ms
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/tempDir-001/control/data, hostContext=/, hostPort=54049, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/cores}
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001'
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1841390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1841398 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1841403 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1841411 INFO  (zkCallback-29516-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b7356d6 name:ZooKeeperConnection Watcher:127.0.0.1:38204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1841411 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1841411 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1841412 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1841412 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/solr.xml
   [junit4]   2> 1841415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/cores
   [junit4]   2> 1841415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.CoreContainer New CoreContainer 611413564
   [junit4]   2> 1841415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001]
   [junit4]   2> 1841415 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/lib
   [junit4]   2> 1841415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1841416 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1841416 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1841417 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1841417 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38204/solr
   [junit4]   2> 1841417 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1841417 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1841428 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1841430 INFO  (zkCallback-29519-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@299bc25d name:ZooKeeperConnection Watcher:127.0.0.1:38204 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1841430 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1841430 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1841431 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$46/1348614197@43878201
   [junit4]   2> 1841431 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1841432 INFO  (zkCallback-29520-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@26b10ea0 name:ZooKeeperConnection Watcher:127.0.0.1:38204/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1841432 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1841432 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1841433 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1841434 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1841435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1841444 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1841446 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1841447 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1841447 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1841448 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1841448 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1841449 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1841449 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1841450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1841451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1841451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95963833530515460-127.0.0.1:54049_-n_0000000000
   [junit4]   2> 1841451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54049_
   [junit4]   2> 1841451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1841451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.Overseer Overseer (id=95963833530515460-127.0.0.1:54049_-n_0000000000) starting
   [junit4]   2> 1841452 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1841455 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1841455 INFO  (OverseerStateUpdate-95963833530515460-127.0.0.1:54049_-n_0000000000) [n:127.0.0.1:54049_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1841461 INFO  (OverseerCollectionConfigSetProcessor-95963833530515460-127.0.0.1:54049_-n_0000000000) [n:127.0.0.1:54049_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1841472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54049_
   [junit4]   2> 1841472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54049_
   [junit4]   2> 1841473 INFO  (OverseerStateUpdate-95963833530515460-127.0.0.1:54049_-n_0000000000) [n:127.0.0.1:54049_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1841480 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1841480 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1841481 INFO  (zkCallback-29520-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1841481 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/cores
   [junit4]   2> 1841482 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1841482 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_33FD9B2EC1BC674F-001/control-001/cores/collection1
   [junit4]   2> 1841482 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1841482 INFO  (zkCallback-29520-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1841483 INFO  (coreLoadExecutor-9006-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1841483 INFO  (coreLoadExecutor-9006-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1841483 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 1841483 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[33FD9B2EC1BC674F]) [n:127.0.0.1:54049_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1841486 INFO  (coreLoadExecutor-9006-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
   [junit4]   2> 1841486 INFO  (coreLoadExecutor-9006-thread-1-processing-n:127.0.0.1:54049_) [n:127.0.0.1:54049_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [control_collection]
   [junit4]   2> 1841486 INFO  (OverseerStateUpdate-95963833530515460-127.0.0.1:54049_-n_0000000000) [n:127.0.0.1:54049_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54049",
   [junit4]   2>   "node_name":"127.0.0.1:54049_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4] 

[...truncated too long message...]

a watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/collections/.system/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDynamicLoading -Dtests.method=testDynamicLoading -Dtests.seed=33FD9B2EC1BC674F -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=mk-MK -Dtests.timezone=Pacific/Pohnpei -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 48.6s J1 | TestDynamicLoading.testDynamicLoading <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Could not find collection:.system
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([33FD9B2EC1BC674F:EBB0B6793661C2EF]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:151)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:130)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:852)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.testDynamicLoading(TestDynamicLoading.java:116)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4404930 INFO  (SUITE-TestDynamicLoading-seed#[33FD9B2EC1BC674F]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading_33FD9B2EC1BC674F-001
   [junit4]   2> May 26, 2016 8:27:37 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60), sim=ClassicSimilarity, locale=mk-MK, timezone=Pacific/Pohnpei
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=172793320,total=532152320
   [junit4]   2> NOTE: All tests run in this JVM: [TestMaxScoreQueryParser, OpenCloseCoreStressTest, AddSchemaFieldsUpdateProcessorFactoryTest, SolrIndexSplitterTest, TestCloudManagedSchema, ConvertedLegacyTest, TestManagedStopFilterFactory, TestDistributedStatsComponentCardinality, HdfsChaosMonkeySafeLeaderTest, BasicFunctionalityTest, TestManagedResource, TestBM25SimilarityFactory, HdfsLockFactoryTest, TestExclusionRuleCollectionAccess, SolrCmdDistributorTest, DistributedQueueTest, ConfigSetsAPITest, SpellingQueryConverterTest, OverseerRolesTest, TestPerFieldSimilarityWithDefaultOverride, DistributedIntervalFacetingTest, DocExpirationUpdateProcessorFactoryTest, TestSha256AuthenticationProvider, TestUpdate, DeleteReplicaTest, AsyncMigrateRouteKeyTest, TestSmileRequest, ShardRoutingTest, CachingDirectoryFactoryTest, SpellPossibilityIteratorTest, TestCollationFieldDocValues, NotRequiredUniqueKeyTest, TestSolrXml, SharedFSAutoReplicaFailoverUtilsTest, SoftAutoCommitTest, DirectSolrSpellCheckerTest, HdfsDirectoryFactoryTest, TestBulkSchemaAPI, TestDistribIDF, SchemaVersionSpecificBehaviorTest, ZkCLITest, TestExceedMaxTermLength, RestartWhileUpdatingTest, AliasIntegrationTest, TermsComponentTest, MBeansHandlerTest, SolrXmlInZkTest, SolrInfoMBeanTest, SolrIndexConfigTest, ChaosMonkeyNothingIsSafeTest, ChangedSchemaMergeTest, TestReloadDeadlock, TestRestoreCore, TestFreeTextSuggestions, TermVectorComponentTest, TestChildDocTransformer, TestSolrConfigHandlerConcurrent, CdcrReplicationHandlerTest, TestQueryUtils, TestSolrQueryParserDefaultOperatorResource, HdfsSyncSliceTest, TestConfigSetsAPI, SuggesterFSTTest, DocumentBuilderTest, TestSolrCoreProperties, DistributedFacetPivotLargeTest, TestJsonFacets, TestDFISimilarityFactory, CustomCollectionTest, TimeZoneUtilsTest, TestInitParams, TestPartialUpdateDeduplication, EnumFieldTest, DistanceFunctionTest, TestRebalanceLeaders, PreAnalyzedUpdateProcessorTest, ZkControllerTest, SolrPluginUtilsTest, TestShardHandlerFactory, TestCoreContainer, BlockDirectoryTest, DistanceUnitsTest, CSVRequestHandlerTest, TestWordDelimiterFilterFactory, BlockJoinFacetRandomTest, TestCloudInspectUtil, TestRequestStatusCollectionAPI, TestMiniSolrCloudCluster, TestOverriddenPrefixQueryForCustomFieldType, TestFiltering, CdcrUpdateLogTest, AnalyticsMergeStrategyTest, TestRandomFaceting, ShardRoutingCustomTest, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestRecovery, TestHashPartitioner, TestRealTimeGet, TestJoin, TestReload, TestStressVersions, DistributedTermsComponentTest, SimpleFacetsTest, SpellCheckComponentTest, QueryElevationComponentTest, BadIndexSchemaTest, TestFunctionQuery, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, HighlighterTest, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SpellCheckCollatorTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestStressLucene, TestTrie, SpatialFilterTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, TestReversedWildcardFilterFactory, TestQueryTypes, TestOmitPositions, RequestHandlersTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, PingRequestHandlerTest, TestBinaryResponseWriter, TestLFUCache, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, BadComponentTest, TestSolrDeletionPolicy2, MultiTermTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, TestCharFilters, TestCodecSupport, EchoParamsTest, TestDFRSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, TestFastLRUCache, DateMathParserTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestJettySolrRunner, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionReloadTest, CollectionsAPIAsyncDistributedZkTest, CollectionsAPISolrJTest, DistribCursorPagingTest, HttpPartitionTest, MigrateRouteKeyTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, RollingRestartTest, TestClusterStateMutator, ZkStateWriterTest, RuleEngineTest, DirectoryFactoryTest, ExitableDirectoryReaderTest, QueryResultKeyTest, TestConfigOverlay, TestConfigSetImmutable, TestConfigSetProperties, TestDynamicLoading]
   [junit4] Completed [488/584 (4!)] on J1 in 49.66s, 1 test, 1 failure <<< FAILURES!

[...truncated 308 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2340 tests, 1 suite-level error, 2 errors, 1 failure, 31 ignored (16 assumptions) [seed: 33FD9B2EC1BC674F]

Total time: 207 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 19 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/19/

1 tests failed.
FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([9C6D35E32178A6B1:E3F38266481A8B3B]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:129)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay(ZkStateReaderTest.java:52)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12462 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_9C6D35E32178A6B1-001/init-core-data-001
   [junit4]   2> 4086770 INFO  (SUITE-ZkStateReaderTest-seed#[9C6D35E32178A6B1]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4086773 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 4086773 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4086773 INFO  (Thread-184160) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4086773 INFO  (Thread-184160) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4086873 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer start zk server on port:41306
   [junit4]   2> 4086874 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4086874 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4086876 INFO  (zkCallback-33363-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a5531ce name:ZooKeeperConnection Watcher:127.0.0.1:41306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4086876 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4086876 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4086876 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4086877 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4086877 INFO  (zkCallback-33364-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66b1e9c2 name:ZooKeeperConnection Watcher:127.0.0.1:41306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4086877 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4086878 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4086878 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4086881 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4086881 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4086882 INFO  (zkCallback-33365-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@79f4f972 name:ZooKeeperConnection Watcher:127.0.0.1:41306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4086882 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4086882 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4086882 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4086883 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 4086883 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4086890 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4086890 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4086891 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4086892 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4086892 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 4086893 INFO  (zkCallback-33365-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 4086894 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4086895 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 4086896 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4086896 INFO  (zkCallback-33365-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4086897 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41306 41306
   [junit4]   2> 4087059 INFO  (Thread-184160) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41306 41306
   [junit4]   2> 4087059 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 4087063 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 4087063 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4087063 INFO  (Thread-184161) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4087063 INFO  (Thread-184161) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4087163 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer start zk server on port:58929
   [junit4]   2> 4087163 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4087164 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4087171 INFO  (zkCallback-33366-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@357ced22 name:ZooKeeperConnection Watcher:127.0.0.1:58929 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4087171 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4087171 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4087172 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4087172 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4087173 INFO  (zkCallback-33367-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f0bf0b3 name:ZooKeeperConnection Watcher:127.0.0.1:58929 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4087173 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4087173 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4087173 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4087175 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4087175 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4087176 INFO  (zkCallback-33368-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@234f79d1 name:ZooKeeperConnection Watcher:127.0.0.1:58929/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4087176 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4087176 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4087176 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4087177 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 4087177 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4087178 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4087179 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4087179 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4087180 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4087180 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 4087180 INFO  (zkCallback-33368-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 4087181 INFO  (zkCallback-33368-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4087182 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 4087182 INFO  (zkCallback-33368-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4087183 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58929 58929
   [junit4]   2> 4087405 INFO  (Thread-184161) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58929 58929
   [junit4]   2> 4087406 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 4087409 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 4087410 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4087410 INFO  (Thread-184162) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4087410 INFO  (Thread-184162) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4087510 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer start zk server on port:56499
   [junit4]   2> 4087510 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4087510 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4087512 INFO  (zkCallback-33369-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@43261b51 name:ZooKeeperConnection Watcher:127.0.0.1:56499 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4087512 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4087513 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4087514 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4087518 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4087519 INFO  (zkCallback-33370-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6eab889f name:ZooKeeperConnection Watcher:127.0.0.1:56499 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4087519 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4087519 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4087519 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4087524 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x154e77f14790001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4087524 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4087525 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4087530 INFO  (zkCallback-33371-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63e1e38a name:ZooKeeperConnection Watcher:127.0.0.1:56499/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4087530 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4087530 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4087530 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4087533 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 4087534 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4087535 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4087536 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4087537 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4087541 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4087541 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 4087542 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 4087542 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 4087542 INFO  (zkCallback-33371-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 4087545 INFO  (zkCallback-33371-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4087547 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 4087547 INFO  (zkCallback-33371-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4087548 INFO  (zkCallback-33371-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4087548 INFO  (zkCallback-33371-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 4087549 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x154e77f14790002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4087550 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56499 56499
   [junit4]   2> 4087930 INFO  (Thread-184162) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56499 56499
   [junit4]   2> 4087931 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithTimeDelay -Dtests.seed=9C6D35E32178A6B1 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ar-JO -Dtests.timezone=America/Guyana -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.53s J0 | ZkStateReaderTest.testStateFormatUpdateWithTimeDelay <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9C6D35E32178A6B1:E3F38266481A8B3B]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:129)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithTimeDelay(ZkStateReaderTest.java:52)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4087936 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWatchedCollectionCreation
   [junit4]   2> 4087936 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4087936 INFO  (Thread-184163) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4087936 INFO  (Thread-184163) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4088036 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer start zk server on port:42254
   [junit4]   2> 4088037 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4088037 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4088039 INFO  (zkCallback-33372-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@475d2edb name:ZooKeeperConnection Watcher:127.0.0.1:42254 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4088039 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4088039 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4088040 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4088040 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4088040 INFO  (zkCallback-33373-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3fffda0a name:ZooKeeperConnection Watcher:127.0.0.1:42254 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4088040 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4088041 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4088041 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4088043 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4088043 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4088043 INFO  (zkCallback-33374-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38ef8a6f name:ZooKeeperConnection Watcher:127.0.0.1:42254/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4088043 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4088043 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4088044 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4088044 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 4088045 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4088048 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4088048 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4088049 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4088052 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4088053 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 4088053 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 4088053 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 4088054 INFO  (zkCallback-33374-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 4088054 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4088055 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 4088055 INFO  (zkCallback-33374-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4088055 INFO  (zkCallback-33374-thread-1) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 4088106 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42254 42254
   [junit4]   2> 4088718 INFO  (Thread-184163) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42254 42254
   [junit4]   2> 4088719 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWatchedCollectionCreation
   [junit4]   2> 4088723 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 4088723 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4088723 INFO  (Thread-184164) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4088723 INFO  (Thread-184164) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4088823 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer start zk server on port:51608
   [junit4]   2> 4088823 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4088824 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4088825 INFO  (zkCallback-33375-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5cd031da name:ZooKeeperConnection Watcher:127.0.0.1:51608 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4088826 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4088826 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4088826 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4088827 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4088827 INFO  (zkCallback-33376-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@487658cf name:ZooKeeperConnection Watcher:127.0.0.1:51608 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4088827 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4088828 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4088828 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4088830 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4088830 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4088830 INFO  (zkCallback-33377-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54ea9e0f name:ZooKeeperConnection Watcher:127.0.0.1:51608/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4088830 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4088831 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4088831 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4088831 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 4088832 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4088833 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4088833 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4088834 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4088835 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4088835 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 4088835 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 4088835 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 4088836 INFO  (zkCallback-33377-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 4088837 INFO  (zkCallback-33377-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4088837 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4088838 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 4088838 INFO  (zkCallback-33377-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4088838 INFO  (zkCallback-33377-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4088838 INFO  (zkCallback-33377-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 4088839 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4088840 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51608 51608
   [junit4]   2> 4089054 INFO  (Thread-184164) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51608 51608
   [junit4]   2> 4089059 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 4089063 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 4089063 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4089066 INFO  (Thread-184165) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4089066 INFO  (Thread-184165) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4089163 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer start zk server on port:39643
   [junit4]   2> 4089163 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4089166 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4089171 INFO  (zkCallback-33378-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@131a8829 name:ZooKeeperConnection Watcher:127.0.0.1:39643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4089171 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4089171 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4089173 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4089177 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4089197 INFO  (zkCallback-33379-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@789116bf name:ZooKeeperConnection Watcher:127.0.0.1:39643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4089198 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4089198 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4089198 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4089211 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4089211 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4089212 INFO  (zkCallback-33380-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ba905e8 name:ZooKeeperConnection Watcher:127.0.0.1:39643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4089212 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4089212 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4089212 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4089213 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 4089213 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4089214 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4089214 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4089215 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4089215 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4089215 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 4089216 INFO  (zkCallback-33380-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 4089216 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 4089217 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4089217 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 4089217 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 4089217 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 4089219 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39643 39643
   [junit4]   2> 4089328 INFO  (Thread-184165) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39643 39643
   [junit4]   2> 4089329 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C6D35E32178A6B1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 4089330 INFO  (SUITE-ZkStateReaderTest-seed#[9C6D35E32178A6B1]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_9C6D35E32178A6B1-001
   [junit4]   2> May 25, 2016 10:39:07 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1803, maxMBSortInHeap=6.679403289405339, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=ar-JO, timezone=America/Guyana
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=214985848,total=517472256
   [junit4]   2> NOTE: All tests run in this JVM: [SolrRequestParserTest, TestSimpleQParserPlugin, SyncSliceTest, TestFunctionQuery, TestRealTimeGet, TestCloudDeleteByQuery, TestRemoteStreaming, HighlighterMaxOffsetTest, CreateCollectionCleanupTest, TestXmlQParser, TestRequestForwarding, DistributedExpandComponentTest, TestUniqueKeyFieldResource, TestDocSet, TestFileDictionaryLookup, SOLR749Test, TestDistributedSearch, TestRandomCollapseQParserPlugin, CollectionTooManyReplicasTest, SuggestComponentTest, TestRestManager, DisMaxRequestHandlerTest, TestSolr4Spatial, QueryEqualityTest, SSLMigrationTest, IndexSchemaRuntimeFieldTest, TestJsonRequest, DefaultValueUpdateProcessorTest, TestDefaultStatsCache, IndexSchemaTest, BasicDistributedZkTest, TestSerializedLuceneMatchVersion, TestRuleBasedAuthorizationPlugin, TestCopyFieldCollectionResource, TestShortCircuitedRequests, TestPerFieldSimilarityClassic, HdfsChaosMonkeyNothingIsSafeTest, TestValueSourceCache, CursorMarkTest, TestBadConfig, ParsingFieldUpdateProcessorsTest, ReplicationFactorTest, StressHdfsTest, TestStressLucene, TestDownShardTolerantSearch, UUIDFieldTest, TestRandomRequestDistribution, TestLMDirichletSimilarityFactory, TestCollectionAPI, ReturnFieldsTest, RulesTest, AsyncCallRequestStatusResponseTest, TestOrdValues, CacheHeaderTest, TestAtomicUpdateErrorCases, SharedFSAutoReplicaFailoverTest, JSONWriterTest, TestAnalyzedSuggestions, ConnectionReuseTest, UUIDUpdateProcessorFallbackTest, HLLUtilTest, MultiThreadedOCPTest, TestConfigSets, TestOmitPositions, DocValuesMissingTest, TestCSVLoader, PingRequestHandlerTest, HdfsRestartWhileUpdatingTest, ExplicitHLLTest, AlternateDirectoryTest, TestFieldSortValues, SecurityConfHandlerTest, OverseerTaskQueueTest, ResponseLogComponentTest, TestRangeQuery, StandardRequestHandlerTest, ExternalFileFieldSortTest, SortSpecParsingTest, HdfsNNFailoverTest, TestConfigSetsAPIZkFailure, TestLazyCores, TestExactStatsCache, TestInitQParser, TestDocBasedVersionConstraints, ForceLeaderTest, TestSchemaResource, TestSortingResponseWriter, BasicZkTest, ConjunctionSolrSpellCheckerTest, TestPseudoReturnFields, TestStressLiveNodes, PolyFieldTest, TestManagedSchemaAPI, TestFaceting, TestFoldingMultitermQuery, TestRandomFaceting, LeaderElectionIntegrationTest, ShardRoutingTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, AutoCommitTest, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestStressReorder, TestJoin, TestReload, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, SpellCheckComponentTest, QueryElevationComponentTest, PeerSyncTest, ConvertedLegacyTest, TestSort, BasicFunctionalityTest, TestIndexSearcher, SoftAutoCommitTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SpellCheckCollatorTest, DocValuesTest, SuggesterTSTTest, SpatialFilterTest, NoCacheHeaderTest, TestUpdate, TestWordDelimiterFilterFactory, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, TestSurroundQueryParser, TestQueryUtils, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, FileBasedSpellCheckerTest, TermsComponentTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, RequiredFieldsTest, TestArbitraryIndexDir, LoggingHandlerTest, RegexBoostProcessorTest, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, HighlighterConfigTest, TestQuerySenderListener, CopyFieldTest, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, EchoParamsTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestIBSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, ScriptEngineTest, URLClassifyProcessorTest, PluginInfoTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, TestRTGBase, CursorPagingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ActionThrottleTest, AsyncMigrateRouteKeyTest, CdcrReplicationDistributedZkTest, HdfsBasicDistributedZkTest, TestClusterStateMutator, ZkStateReaderTest]
   [junit4] Completed [470/584 (1!)] on J0 in 2.83s, 6 tests, 1 error <<< FAILURES!

[...truncated 356 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2340 tests, 1 error, 31 ignored (16 assumptions) [seed: 9C6D35E32178A6B1]

Total time: 194 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 18 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/18/

2 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:33569

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:33569
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:400)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:417)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 47 more


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
[replication.properties, index.properties, index.20160524113742105, index.20160524113728716] expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: [replication.properties, index.properties, index.20160524113742105, index.20160524113728716] expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([10066EB509CAFC6:DAAB662D55B4C675]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.handler.TestReplicationHandler.checkForSingleIndex(TestReplicationHandler.java:900)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12145 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/init-core-data-001
   [junit4]   2> 3071883 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterWrite2Slave
   [junit4]   2> 3071884 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1
   [junit4]   2> 3071886 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 3071891 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@488acdd7{/solr,null,AVAILABLE}
   [junit4]   2> 3071891 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.ServerConnector Started ServerConnector@31a94be8{HTTP/1.1,[http/1.1]}{127.0.0.1:56581}
   [junit4]   2> 3071891 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.Server Started @3074038ms
   [junit4]   2> 3071892 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=56581}
   [junit4]   2> 3071892 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 3071892 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001'
   [junit4]   2> 3071892 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3071892 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3071892 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/solr.xml
   [junit4]   2> 3071896 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/.
   [junit4]   2> 3071896 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer New CoreContainer 185702205
   [junit4]   2> 3071896 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001]
   [junit4]   2> 3071896 WARN  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/lib
   [junit4]   2> 3071896 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 3071897 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 3071897 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3071897 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3071897 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 3071897 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 3071898 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/.
   [junit4]   2> 3071898 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 3071899 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1
   [junit4]   2> 3071899 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 3071899 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1'
   [junit4]   2> 3071899 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 3071899 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 3071899 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3071899 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3071905 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 3071971 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 3071978 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3071980 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 3071982 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 3071988 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1'
   [junit4]   2> 3071988 INFO  (coreLoadExecutor-6589-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1
   [junit4]   2> 3071988 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3071989 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 3071989 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 3071989 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1/data
   [junit4]   2> 3071989 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1/data/index/
   [junit4]   2> 3071989 WARN  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3071990 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 3071991 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.799508674918788]
   [junit4]   2> 3071993 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42303589),segFN=segments_1,generation=1}
   [junit4]   2> 3071993 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 3071995 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3071997 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3071998 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3071998 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3071998 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3071999 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 3071999 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 3071999 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 3071999 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/./collection1/data/
   [junit4]   2> 3072010 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3072010 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3072010 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@6f2f7731
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42303589),segFN=segments_1,generation=1}
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@fdd1d5c[collection1] main]
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1/conf
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1/conf}
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-001/collection1/conf
   [junit4]   2> 3072011 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 3072012 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 3072012 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 3072012 INFO  (coreLoadExecutor-6589-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 3072012 INFO  (searcherExecutor-6590-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@fdd1d5c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3072400 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1
   [junit4]   2> 3072402 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 3072403 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@77d5bfcd{/solr,null,AVAILABLE}
   [junit4]   2> 3072403 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.ServerConnector Started ServerConnector@14e8875f{HTTP/1.1,[http/1.1]}{127.0.0.1:36456}
   [junit4]   2> 3072403 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.e.j.s.Server Started @3074549ms
   [junit4]   2> 3072403 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=36456}
   [junit4]   2> 3072469 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 3072469 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002'
   [junit4]   2> 3072470 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3072470 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3072470 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/solr.xml
   [junit4]   2> 3072472 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/.
   [junit4]   2> 3072473 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer New CoreContainer 394951117
   [junit4]   2> 3072473 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002]
   [junit4]   2> 3072473 WARN  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/lib
   [junit4]   2> 3072473 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 3072473 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 3072474 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3072474 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3072474 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 3072474 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 3072474 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/.
   [junit4]   2> 3072475 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 3072475 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1
   [junit4]   2> 3072475 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 3072475 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 3072475 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1'
   [junit4]   2> 3072475 INFO  (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[10066EB509CAFC6]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 3072475 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3072476 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3072481 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 3072484 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 3072488 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3072489 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 3072491 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 3072491 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1'
   [junit4]   2> 3072492 INFO  (coreLoadExecutor-6599-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1
   [junit4]   2> 3072492 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3072492 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 3072492 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 3072492 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1/data
   [junit4]   2> 3072492 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 3072492 WARN  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3072493 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 3072493 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.799508674918788]
   [junit4]   2> 3072494 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42303589),segFN=segments_1,generation=1}
   [junit4]   2> 3072494 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 3072494 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/./collection1/data/
   [junit4]   2> 3072495 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3072495 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3072496 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3072496 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3072497 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@26dd52f9
   [junit4]   2> 3072498 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/index-MMapDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@42303589),segFN=segments_1,generation=1}
   [junit4]   2> 3072498 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 3072498 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@781314b4[collection1] main]
   [junit4]   2> 3072498 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1/conf
   [junit4]   2> 3072498 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1/conf}
   [junit4]   2> 3072498 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_10066EB509CAFC6-001/solr-instance-002/collection1/conf
   [junit4]   2> 3072499 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 3072500 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 3072500 INFO  (searcherExecutor-6600-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@781314b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3072500 INFO  (coreLoadExecutor-6599-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 3072977 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 3072981 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 1
   [junit4]   2> 3072982 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 3072984 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 3072985 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
   [junit4]   2> 3072987 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
   [junit4]   2> 3072988 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
   [junit4]   2> 3072990 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
   [junit4]   2> 3072991 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
   [junit4]   2> 3072993 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
   [junit4]   2> 3072994 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
   [junit4]   2> 3072996 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
   [junit4]   2> 3073007 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
   [junit4]   2> 3073008 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
   [junit4]   2> 3073010 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
   [junit4]   2> 3073011 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
   [junit4]   2> 3073012 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
   [junit4]   2> 3073014 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
   [junit4]   2> 3073015 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
   [junit4]   2> 3073017 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
   [junit4]   2> 3073018 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
   [junit4]   2> 3073019 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
   [junit4]   2> 3073021 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
   [junit4]   2> 3073022 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
   [junit4]   2> 3073023 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
   [junit4]   2> 3073025 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
   [junit4]   2> 3073026 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
   [junit4]   2> 3073028 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
   [junit4]   2> 3073029 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
   [junit4]   2> 3073030 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
   [junit4]   2> 3073032 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
   [junit4]   2> 3073033 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
   [junit4]   2> 3073034 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
   [junit4]   2> 3073036 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
   [junit4]   2> 3073037 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
   [junit4]   2> 3073039 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
   [junit4]   2> 3073040 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
   [junit4]   2> 3073041 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
   [junit4]   2> 3073043 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
   [junit4]   2> 3073044 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0
   [junit4]   2> 3073046 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
   [junit4]   2> 3073047 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
   [junit4]   2> 3073048 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
   [junit4]   2> 3073050 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0
   [junit4]   2> 3073051 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 0
   [junit4]   2> 3073053 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
   [junit4]   2> 3073054 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
   [junit4]   2> 3073055 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
   [junit4]   2> 3073057 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 0
   [junit4]   2> 3073058 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0
   [junit4]   2> 3073059 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0
   [junit4]   2> 3073061 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0
   [junit4]   2> 3073062 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 0
   [junit4]   2> 3073064 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0
   [junit4]   2> 3073065 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0
   [junit4]   2> 3073066 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0
   [junit4]   2> 3073068 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 0
   [junit4]   2> 3073069 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0
   [junit4]   2> 3073071 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0
   [junit4]   2> 3073072 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0
   [junit4]   2> 3073073 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 0
   [junit4]   2> 3073075 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0
   [junit4]   2> 3073076 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0
   [junit4]   2> 3073077 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0
   [junit4]   2> 3073079 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 0
   [junit4]   2> 3073080 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0
   [junit4]   2> 3073082 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0
   [junit4]   2> 3073083 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0
   [junit4]   2> 3073084 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 0
   [junit4]   2> 3073086 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0
   [junit4]   2> 3073087 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0
   [junit4]   2> 3073089 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0
   [junit4]   2> 3073090 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 0
   [junit4]   2> 3073091 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0
   [junit4]   2> 3073093 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0
   [junit4]   2> 3073094 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[74]} 0 0
   [junit4]   2> 3073095 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[75]} 0 0
   [junit4]   2> 3073097 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[76]} 0 0
   [junit4]   2> 3073098 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[77]} 0 0
   [junit4]   2> 3073100 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[78]} 0 0
   [junit4]   2> 3073101 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[79]} 0 0
   [junit4]   2> 3073102 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[80]} 0 0
   [junit4]   2> 3073104 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[81]} 0 0
   [junit4]   2> 3073105 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[82]} 0 0
   [junit4]   2> 3073106 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[83]} 0 0
   [junit4]   2> 3073108 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[84]} 0 0
   [junit4]   2> 3073109 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[85]} 0 0
   [junit4]   2> 3073111 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[86]} 0 0
   [junit4]   2> 3073112 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[87]} 0 0
   [junit4]   2> 3073113 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[88]} 0 0
   [junit4]   2> 3073115 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[89]} 0 0
   [junit4]   2> 3073116 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[90]} 0 0
   [junit4]   2> 3073117 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[91]} 0 0
   [junit4]   2> 3073119 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[92]} 0 0
   [junit4]   2> 3073120 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[93]} 0 0
   [junit4]   2> 3073122 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[94]} 0 0
   [junit4]   2> 3073123 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[95]} 0 0
   [junit4]   2> 3073125 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[96]} 0 0
   [junit4]   2> 3073126 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[97]} 0 0
   [junit4]   2> 3073127 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[98]} 0 0
   [junit4]   2> 3073129 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[99]} 0 0
   [junit4]   2> 3073130 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[100]} 0 0
   [junit4]   2> 3073131 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[101]} 0 0
   [junit4]   2> 3073133 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[102]} 0 0
   [junit4]   2> 3073135 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[103]} 0 0
   [junit4]   2> 3073136 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[104]} 0 0
   [junit4]   2> 3073138 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[105]} 0 0
   [junit4]   2> 3073139 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[106]} 0 0
   [junit4]   2> 3073141 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[107]} 0 0
   [junit4]   2> 3073143 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[108]} 0 0
   [junit4]   2> 3073145 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[109]} 0 0
   [junit4]   2> 3073146 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[110]} 0 0
   [junit4]   2> 3073148 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[111]} 0 0
   [junit4]   2> 3073150 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[112]} 0 0
   [junit4]   2> 3073151 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[113]} 0 0
   [junit4]   2> 3073153 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[114]} 0 0
   [junit4]   2> 3073154 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[115]} 0 0
   [junit4]   2> 3073155 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[116]} 0 0
   [junit4]   2> 3073157 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[117]} 0 0
   [junit4]   2> 3073158 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[118]} 0 0
   [junit4]   2> 3073160 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[119]} 0 0
   [junit4]   2> 3073161 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[120]} 0 0
   [junit4]   2> 3073162 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[121]} 0 0
   [junit4]   2> 3073164 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[122]} 0 0
   [junit4]   2> 3073165 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[123]} 0 0
   [junit4]   2> 3073166 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[124]} 0 0
   [junit4]   2> 3073168 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[125]} 0 0
   [junit4]   2> 3073169 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[126]} 0 0
   [junit4]   2> 3073171 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[127]} 0 0
   [junit4]   2> 3073172 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[128]} 0 0
   [junit4]   2> 3073173 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[129]} 0 0
   [junit4]   2> 3073175 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[130]} 0 0
   [junit4]   2> 3073176 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[131]} 0 0
   [junit4]   2> 3073178 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[132]} 0 0
   [junit4]   2> 3073179 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[133]} 0 0
   [junit4]   2> 3073180 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[134]} 0 0
   [junit4]   2> 3073182 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[135]} 0 0
   [junit4]   2> 3073183 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[136]} 0 0
   [junit4]   2> 3073184 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[137]} 0 0
   [junit4]   2> 3073186 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[138]} 0 0
   [junit4]   2> 3073187 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[139]} 0 0
   [junit4]   2> 3073189 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[140]} 0 0
   [junit4]   2> 3073190 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[141]} 0 0
   [junit4]   2> 3073191 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[142]} 0 0
   [junit4]   2> 3073193 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[143]} 0 0
   [junit4]   2> 3073194 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[144]} 0 0
   [junit4]   2> 3073196 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[145]} 0 0
   [junit4]   2> 3073197 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[146]} 0 0
   [junit4]   2> 3073198 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[147]} 0 0
   [junit4]   2> 3073200 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[148]} 0 0
   [junit4]   2> 3073201 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[149]} 0 0
   [junit4]   2> 3073202 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[150]} 0 0
   [junit4]   2> 3073204 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[151]} 0 0
   [junit4]   2> 3073205 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[152]} 0 0
   [junit4]   2> 3073207 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[153]} 0 0
   [junit4]   2> 3073208 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[154]} 0 0
   [junit4]   2> 3073209 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[155]} 0 0
   [junit4]   2> 3073211 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[156]} 0 0
   [junit4]   2> 3073212 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[157]} 0 0
   [junit4]   2> 3073214 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[158]} 0 0
   [junit4]   2> 3073215 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[159]} 0 0
   [junit4]   2> 3073216 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[160]} 0 0
   [junit4]   2> 3073218 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[161]} 0 0
   [junit4]   2> 3073219 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[162]} 0 0
   [junit4]   2> 3073220 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[163]} 0 0
   [junit4]   2> 3073222 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[164]} 0 0
   [junit4]   2> 3073223 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[165]} 0 0
   [junit4]   2> 3073225 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[166]} 0 0
   [junit4]   2> 3073226 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[167]} 0 0
   [junit4]   2> 3073227 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[168]} 0 0
   [junit4]   2> 3073229 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[169]} 0 0
   [junit4]   2> 3073230 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[170]} 0 0
   [junit4]   2> 3073232 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[171]} 0 0
   [junit4]   2> 3073233 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[172]} 0 0
   [junit4]   2> 3073234 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[173]} 0 0
   [junit4]   2> 3073236 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[174]} 0 0
   [junit4]   2> 3073237 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[175]} 0 0
   [junit4]   2> 3073238 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[176]} 0 0
   [junit4]   2> 3073240 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[177]} 0 0
   [junit4]   2> 3073241 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[178]} 0 0
   [junit4]   2> 3073243 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[179]} 0 0
   [junit4]   2> 3073244 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[180]} 0 0
   [junit4]   2> 3073245 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[181]} 0 0
   [junit4]   2> 3073247 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[182]} 0 0
   [junit4]   2> 3073248 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[183]} 0 0
   [junit4]   2> 3073249 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[184]} 0 0
   [junit4]   2> 3073251 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[185]} 0 0
   [junit4]   2> 3073252 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[186]} 0 0
   [junit4]   2> 3073254 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[187]} 0 0
   [junit4]   2> 3073255 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[188]} 0 0
   [junit4]   2> 3073256 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[189]} 0 0
   [junit4]   2> 3073258 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[190]} 0 0
   [junit4]   2> 3073259 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[191]} 0 0
   [junit4]   2> 3073260 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[192]} 0 0
   [junit4]   2> 3073262 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[193]} 0 0
   [junit4]   2> 3073263 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[194]} 0 0
   [junit4]   2> 3073265 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[195]} 0 0
   [junit4]   2> 3073266 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[196]} 0 0
   [junit4]   2> 3073267 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[197]} 0 0
   [junit4]   2> 3073269 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[198]} 0 0
   [junit4]   2> 3073270 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[199]} 0 0
   [junit4]   2> 3073272 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[200]} 0 0
   [junit4]   2> 3073273 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[201]} 0 0
   [junit4]   2> 3073274 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[202]} 0 0
   [junit4]   2> 3073276 INFO  (qtp1001983482-68234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[203]} 0 0
   [junit4]   2> 3073277 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[204]} 0 0
   [junit4]   2> 3073278 INFO  (qtp1001983482-68232) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[205]} 0 0
   [junit4]   2> 3073280 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[206]} 0 0
   [junit4]   2> 3073281 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[207]} 0 0
   [junit4]   2> 3073283 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[208]} 0 0
   [junit4]   2> 3073284 INFO  (qtp1001983482-68233) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[209]} 0 0
   [junit4]   2> 3073285 INFO  (qtp1001983482-68228) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 3073285 INFO  (qtp1001983482-68231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[210]} 0 0
   [junit4]   2> 3073287 INFO  (qtp1001983482-68235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[211]} 0 0
   [junit4]   2> 3073288 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[212]} 0 0
   [junit4]   2> 3073290 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[213]} 0 0
   [junit4]   2> 3073291 INFO  (qtp1001983482-68229) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[214]} 0 0
   [junit4]   2> 3073292 INFO  (qtp1001983482-68

[...truncated too long message...]

.snapshot(MethodMetric.java:111)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:52)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 54 more
   [junit4]   2> 4071675 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[10066EB509CAFC6]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_10066EB509CAFC6-001
   [junit4]   2> May 24, 2016 5:20:24 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60), sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=ko-KR, timezone=America/Martinique
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=113954024,total=514850816
   [junit4]   2> NOTE: All tests run in this JVM: [ShowFileRequestHandlerTest, OverseerStatusTest, SimpleFacetsTest, CoreAdminHandlerTest, TestMinMaxOnMultiValuedField, TestSolrQueryParserResource, BlockJoinFacetSimpleTest, SimpleCollectionCreateDeleteTest, CheckHdfsIndexTest, TestFastWriter, TestSolrQueryResponse, HdfsRecoveryZkTest, TermVectorComponentDistributedTest, MigrateRouteKeyTest, TestConfigSetProperties, TestHashQParserPlugin, TestPostingsSolrHighlighter, TestManagedSynonymFilterFactory, QueryParsingTest, TestSweetSpotSimilarityFactory, HighlighterConfigTest, DirectoryFactoryTest, FieldMutatingUpdateProcessorTest, TestSolrIndexConfig, DistributedSuggestComponentTest, TestHdfsUpdateLog, DirectUpdateHandlerOptimizeTest, TestSearchPerf, TestSolrJ, QueryResultKeyTest, DistributedVersionInfoTest, TestNonDefinedSimilarityFactory, TestSolrConfigHandler, TestNRTOpen, TestMiniSolrCloudClusterBase, BaseCdcrDistributedZkTest, InfoHandlerTest, DistributedFacetPivotLongTailTest, DistribDocExpirationUpdateProcessorTest, HardAutoCommitTest, TestCollationField, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [378/584 (2!)] on J2 in 3611.86s, 1 test, 1 error <<< FAILURES!

[...truncated 668 lines...]
   [junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/temp/junit4-J2-20160524_041231_255.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/heapdumps/java_pid6779.hprof ...
   [junit4] Heap dump file created [724951182 bytes in 146.609 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 14 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2340 tests, 1 error, 1 failure, 31 ignored (16 assumptions) [seed: 10066EB509CAFC6]

Total time: 213 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 17 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/17/

6 tests failed.
FAILED:  org.apache.solr.cloud.RollingRestartTest.test

Error Message:
Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:48745/collection1]

Stack Trace:
java.lang.AssertionError: Unable to restart (#6): CloudJettyRunner [url=http://127.0.0.1:48745/collection1]
	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:A19ED091F969DC10]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:103)
	at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test

Error Message:
There were too many update fails (64 > 60) - we expect it can happen, but shouldn't easily

Stack Trace:
java.lang.AssertionError: There were too many update fails (64 > 60) - we expect it can happen, but shouldn't easily
	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:A19ED091F969DC10]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertFalse(Assert.java:68)
	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:216)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest

Error Message:
ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [HdfsTransactionLog]
	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:36709EBC87F5772D]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh(ZkStateReaderTest.java:42)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 6 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 6 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
	at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=9989, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9989, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45335: Could not find collection : awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)




Build Log:
[...truncated 11409 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_29CAEF4B5795B1E8-001/init-core-data-001
   [junit4]   2> 813825 INFO  (SUITE-ZkStateReaderTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 813827 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 813827 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 813830 INFO  (Thread-4408) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 813830 INFO  (Thread-4408) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 813930 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:39674
   [junit4]   2> 813930 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 813930 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 813934 INFO  (zkCallback-1225-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7fb3f666 name:ZooKeeperConnection Watcher:127.0.0.1:39674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 813934 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 813934 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 813935 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 813935 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 813936 INFO  (zkCallback-1226-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ee56a15 name:ZooKeeperConnection Watcher:127.0.0.1:39674 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 813936 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 813936 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 813936 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 813940 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 813940 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 813941 INFO  (zkCallback-1227-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@173ad290 name:ZooKeeperConnection Watcher:127.0.0.1:39674/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 813941 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 813941 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 813942 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 813942 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 813943 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 813944 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 813945 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 813946 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 813947 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 813948 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 813949 INFO  (zkCallback-1227-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 813950 INFO  (zkCallback-1227-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814000 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 814000 INFO  (zkCallback-1227-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814002 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39674 39674
   [junit4]   2> 814128 INFO  (Thread-4408) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39674 39674
   [junit4]   2> 814129 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 814131 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 814131 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 814132 INFO  (Thread-4409) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 814132 INFO  (Thread-4409) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 814232 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:56816
   [junit4]   2> 814232 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814232 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814234 INFO  (zkCallback-1228-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50559e02 name:ZooKeeperConnection Watcher:127.0.0.1:56816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814234 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814234 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814235 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814235 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814235 INFO  (zkCallback-1229-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5fe3ff65 name:ZooKeeperConnection Watcher:127.0.0.1:56816 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814236 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814236 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814236 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 814238 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814238 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814238 INFO  (zkCallback-1230-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@33511417 name:ZooKeeperConnection Watcher:127.0.0.1:56816/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814238 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814238 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814239 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 814239 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 814240 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 814240 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 814241 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 814241 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 814242 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814242 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 814243 INFO  (zkCallback-1230-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 814243 INFO  (zkCallback-1230-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814244 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814244 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 814245 INFO  (zkCallback-1230-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814245 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814246 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56816 56816
   [junit4]   2> 814450 INFO  (Thread-4409) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56816 56816
   [junit4]   2> 814451 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 814453 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 814454 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 814455 INFO  (Thread-4410) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 814455 INFO  (Thread-4410) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 814555 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:48455
   [junit4]   2> 814555 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814565 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814583 INFO  (zkCallback-1231-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ffc2633 name:ZooKeeperConnection Watcher:127.0.0.1:48455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814583 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814584 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814591 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814599 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814614 INFO  (zkCallback-1232-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b93916 name:ZooKeeperConnection Watcher:127.0.0.1:48455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814615 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814615 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814615 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 814617 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814630 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814637 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@37140a93 name:ZooKeeperConnection Watcher:127.0.0.1:48455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814637 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814637 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814638 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 814639 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 814639 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 814640 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 814640 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 814640 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 814641 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814641 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 814641 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 814641 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 814642 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 814646 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814646 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 814648 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814648 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 814648 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814652 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48455 48455
   [junit4]   2> 814764 INFO  (Thread-4410) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48455 48455
   [junit4]   2> 814770 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 814772 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 814773 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 814773 INFO  (Thread-4411) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 814773 INFO  (Thread-4411) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 814873 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:58510
   [junit4]   2> 814873 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814879 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814890 INFO  (zkCallback-1234-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2254fffe name:ZooKeeperConnection Watcher:127.0.0.1:58510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814890 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814890 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814891 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814892 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814895 INFO  (zkCallback-1235-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b02d773 name:ZooKeeperConnection Watcher:127.0.0.1:58510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814895 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814895 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814895 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 814899 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 814899 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 814900 INFO  (zkCallback-1236-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2722398a name:ZooKeeperConnection Watcher:127.0.0.1:58510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 814900 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 814900 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 814900 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 814901 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 814903 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 814904 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 814906 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 814907 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 814910 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814912 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 814912 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 814912 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 814913 INFO  (zkCallback-1236-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 814913 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814914 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 814915 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 814928 ERROR (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]-EventThread) [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$9/1382749964@384b380f rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7d49a162[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 2]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 814930 INFO  (zkCallback-1236-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 814930 WARN  (zkCallback-1236-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /clusterstate.json]
   [junit4]   2> 814931 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58510 58510
   [junit4]   2> 815136 INFO  (Thread-4411) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58510 58510
   [junit4]   2> 815137 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithExplicitRefresh -Dtests.seed=29CAEF4B5795B1E8 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es-CL -Dtests.timezone=SystemV/YST9YDT -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.37s J2 | ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([29CAEF4B5795B1E8:36709EBC87F5772D]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh(ZkStateReaderTest.java:42)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 815144 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 815144 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 815145 INFO  (Thread-4412) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 815146 INFO  (Thread-4412) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 815245 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:53554
   [junit4]   2> 815246 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815246 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815252 INFO  (zkCallback-1237-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@159338ed name:ZooKeeperConnection Watcher:127.0.0.1:53554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815252 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815252 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815253 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815261 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815262 INFO  (zkCallback-1238-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f709adb name:ZooKeeperConnection Watcher:127.0.0.1:53554 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815262 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815263 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815263 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 815265 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815265 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815266 INFO  (zkCallback-1239-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2830aa38 name:ZooKeeperConnection Watcher:127.0.0.1:53554/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815266 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815266 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815266 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 815267 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 815268 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 815268 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 815271 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 815273 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 815274 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815274 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 815276 INFO  (zkCallback-1239-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 815276 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 815277 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815278 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 815278 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 815278 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 815280 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53554 53554
   [junit4]   2> 815475 INFO  (Thread-4412) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53554 53554
   [junit4]   2> 815479 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 815485 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testWatchedCollectionCreation
   [junit4]   2> 815485 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 815485 INFO  (Thread-4413) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 815485 INFO  (Thread-4413) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 815585 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:41608
   [junit4]   2> 815585 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815593 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815595 INFO  (zkCallback-1240-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@a90e385 name:ZooKeeperConnection Watcher:127.0.0.1:41608 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815595 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815595 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815598 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815606 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815607 INFO  (zkCallback-1241-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e69958 name:ZooKeeperConnection Watcher:127.0.0.1:41608 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815607 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815607 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815607 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 815611 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 815632 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 815632 INFO  (zkCallback-1242-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4abd38 name:ZooKeeperConnection Watcher:127.0.0.1:41608/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 815634 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 815634 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 815638 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 815638 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 815639 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 815639 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 815640 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 815640 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 815641 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815641 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 815641 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 815641 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 815642 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 815643 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 815643 INFO  (zkCallback-1242-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 815643 INFO  (zkCallback-1242-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 815644 INFO  (zkCallback-1242-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 815696 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41608 41608
   [junit4]   2> 816108 INFO  (Thread-4413) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41608 41608
   [junit4]   2> 816109 INFO  (TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testWatchedCollectionCreation
   [junit4]   2> 816110 INFO  (SUITE-ZkStateReaderTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_29CAEF4B5795B1E8-001
   [junit4]   2> May 23, 2016 5:49:14 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=9, maxDocsPerChunk=6, blockSize=10), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=9, blockSize=10)), sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=es-CL, timezone=SystemV/YST9YDT
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=179526928,total=531103744
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtils, HLLSerializationTest, TestReplicaProperties, TestHdfsUpdateLog, DataDrivenBlockJoinTest, TestExpandComponent, TestZkChroot, InfoHandlerTest, RankQueryTest, TestMiniSolrCloudClusterBase, TestJmxIntegration, TestTolerantSearch, PrimitiveFieldTypeTest, TestHashQParserPlugin, TestReload, TestMissingGroups, SpatialRPTFieldTypeTest, AnalyticsQueryTest, CleanupOldIndexTest, OverseerStatusTest, TestFieldResource, TestSQLHandler, TestMinMaxOnMultiValuedField, TestDynamicFieldCollectionResource, AtomicUpdatesTest, BinaryUpdateRequestHandlerTest, PluginInfoTest, AssignTest, RemoteQueryErrorTest, TestSolrJ, BadComponentTest, UnloadDistributedZkTest, DirectUpdateHandlerOptimizeTest, SuggesterTSTTest, RegexBoostProcessorTest, TestFuzzyAnalyzedSuggestions, TestSSLRandomization, DistributedFacetPivotLongTailTest, TestStressReorder, DateMathParserTest, TestJmxMonitoredMap, TestNRTOpen, AddBlockUpdateTest, TestSchemaNameResource, DeleteShardTest, TestAuthenticationFramework, FieldAnalysisRequestHandlerTest, LukeRequestHandlerTest, QueryParsingTest, BufferStoreTest, SimpleCollectionCreateDeleteTest, TestElisionMultitermQuery, DeleteInactiveReplicaTest, AutoCommitTest, CurrencyFieldXmlFileTest, DirectUpdateHandlerTest, TestManagedSynonymFilterFactory, HighlighterConfigTest, BaseCdcrDistributedZkTest, DistributedFacetPivotWhiteBoxTest, TestPKIAuthenticationPlugin, RequestHandlersTest, TestIndexSearcher, UpdateParamsTest, OverriddenZkACLAndCredentialsProvidersTest, BasicDistributedZk2Test, JavabinLoaderTest, TestDistributedMissingSort, TestJettySolrRunner, CollectionStateFormat2Test, ClusterStateTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SuggestComponentContextFilterQueryTest, TestSweetSpotSimilarityFactory, CoreAdminCreateDiscoverTest, TestSolrDeletionPolicy1, TestSearchPerf, BitVectorTest, TestNamedUpdateProcessors, DistributedDebugComponentTest, TestGroupingSearch, TestIntervalFaceting, TestOnReconnectListenerSupport, ZkStateReaderTest]
   [junit4] Completed [157/584 (1!)] on J2 in 2.81s, 6 tests, 1 error <<< FAILURES!

[...truncated 27 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/init-core-data-001
   [junit4]   2> 753745 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 753777 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 753786 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 753788 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 753799 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_42310_hdfs____rg775q/webapp
   [junit4]   2> 753876 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 754159 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42310
   [junit4]   2> 754206 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 754207 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 754215 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_50453_datanode____7utz9a/webapp
   [junit4]   2> 754291 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 754600 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50453
   [junit4]   2> 754643 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 754644 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 754659 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37269_datanode____tqsdtk/webapp
   [junit4]   2> 754727 INFO  (IPC Server handler 3 on 34655) [    ] BlockStateChange BLOCK* processReport: from storage DS-344877d6-eb69-44d6-b82a-8bcb2429bfbd node DatanodeRegistration(127.0.0.1, datanodeUuid=2a6f9b40-428a-4d1f-964a-6d8805fc65e3, infoPort=50453, ipcPort=42208, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 754727 INFO  (IPC Server handler 3 on 34655) [    ] BlockStateChange BLOCK* processReport: from storage DS-16c6665e-9db9-47bb-9823-3c95bb5f65b0 node DatanodeRegistration(127.0.0.1, datanodeUuid=2a6f9b40-428a-4d1f-964a-6d8805fc65e3, infoPort=50453, ipcPort=42208, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 754793 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 755151 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[29CAEF4B5795B1E8]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37269
   [junit4]   2> 755245 INFO  (IPC Server handler 0 on 34655) [    ] BlockStateChange BLOCK* processReport: from storage DS-ce06f900-d6e4-42c5-8c20-80dd97f265d3 node DatanodeRegistration(127.0.0.1, datanodeUuid=7720753c-58bc-4b75-ab40-0737022dd664, infoPort=37269, ipcPort=33487, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 755246 INFO  (IPC Server handler 0 on 34655) [    ] BlockStateChange BLOCK* processReport: from storage DS-4f157fa6-0255-473e-bde1-c9f5065872c9 node DatanodeRegistration(127.0.0.1, datanodeUuid=7720753c-58bc-4b75-ab40-0737022dd664, infoPort=37269, ipcPort=33487, storageInfo=lv=-56;cid=testClusterID;nsid=661043492;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 755322 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 755322 INFO  (Thread-1738) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 755322 INFO  (Thread-1738) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 755422 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.ZkTestServer start zk server on port:37618
   [junit4]   2> 755422 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 755426 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 755429 INFO  (zkCallback-585-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c68a54f name:ZooKeeperConnection Watcher:127.0.0.1:37618 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 755429 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 755429 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 755429 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 755431 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 755434 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 755435 INFO  (zkCallback-586-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f031aea name:ZooKeeperConnection Watcher:127.0.0.1:37618/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 755435 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 755435 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 755435 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 755436 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 755437 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 755437 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 755438 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 755438 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 755439 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 755439 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 755440 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 755440 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 755441 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 755441 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 755442 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 755442 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 755445 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 755445 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 755450 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 755450 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 755451 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 755451 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 755452 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 755452 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 755455 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 755455 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 755456 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 755456 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 755521 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/cores/collection1
   [junit4]   2> 755522 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 755523 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@467a3972{/,null,AVAILABLE}
   [junit4]   2> 755523 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.e.j.s.ServerConnector Started ServerConnector@f28ea04{HTTP/1.1,[http/1.1]}{127.0.0.1:54292}
   [junit4]   2> 755523 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.e.j.s.Server Started @757579ms
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:34655/hdfs__localhost_34655__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001_tempDir-002_control_data, hostContext=/, hostPort=54292, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/cores}
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001'
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 755524 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 755527 INFO  (zkCallback-587-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f122e65 name:ZooKeeperConnection Watcher:127.0.0.1:37618/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 755527 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 755527 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 755528 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 755528 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/solr.xml
   [junit4]   2> 755532 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/cores
   [junit4]   2> 755532 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.CoreContainer New CoreContainer 829332570
   [junit4]   2> 755532 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001]
   [junit4]   2> 755532 WARN  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_29CAEF4B5795B1E8-001/control-001/lib
   [junit4]   2> 755532 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[29CAEF4B5795B1E8]) [    ] o.a.s.h.c.HttpShardHandl

[...truncated too long message...]

-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/mockito-core-1.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.1-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/contrib/analysis-extras/lib/icu4j-56.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/temp/junit4-J0-20160523_053536_198.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/temp/junit4-J0-20160523_053536_198.suites -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4] 	at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 195 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 16 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/16/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=4632, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4632, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38813/fw_w/g: Could not find collection : awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([21D3B069732F15C5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:40269/ho_urd

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:40269/ho_urd
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:400)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:458)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 47 more




Build Log:
[...truncated 11211 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/init-core-data-001
   [junit4]   2> 418830 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 418831 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ho_urd/
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 418883 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 418888 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 418891 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 418906 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_46791_hdfs____3aap9z/webapp
   [junit4]   2> 419050 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 419405 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46791
   [junit4]   2> 419541 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 419542 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 419561 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37578_datanode____u01as9/webapp
   [junit4]   2> 419651 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 420514 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37578
   [junit4]   2> 420555 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 420556 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 420582 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_51244_datanode____o36m0t/webapp
   [junit4]   2> 420666 INFO  (IPC Server handler 4 on 38992) [    ] BlockStateChange BLOCK* processReport: from storage DS-c41db882-7d12-44ca-8beb-e7462c3d429c node DatanodeRegistration(127.0.0.1, datanodeUuid=6a82eeec-5809-4ed0-bb91-a6e00e4257f9, infoPort=37578, ipcPort=48904, storageInfo=lv=-56;cid=testClusterID;nsid=2144198505;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 420666 INFO  (IPC Server handler 4 on 38992) [    ] BlockStateChange BLOCK* processReport: from storage DS-4f80829f-dca2-4408-b178-7a4db69c9c4d node DatanodeRegistration(127.0.0.1, datanodeUuid=6a82eeec-5809-4ed0-bb91-a6e00e4257f9, infoPort=37578, ipcPort=48904, storageInfo=lv=-56;cid=testClusterID;nsid=2144198505;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 420726 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 420934 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:51244
   [junit4]   2> 421049 INFO  (IPC Server handler 0 on 38992) [    ] BlockStateChange BLOCK* processReport: from storage DS-2b2c137a-5359-4692-96a4-8ac420719c6d node DatanodeRegistration(127.0.0.1, datanodeUuid=156edfd6-30d3-4258-9f8d-5b25fa31f0bd, infoPort=51244, ipcPort=48392, storageInfo=lv=-56;cid=testClusterID;nsid=2144198505;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 421050 INFO  (IPC Server handler 0 on 38992) [    ] BlockStateChange BLOCK* processReport: from storage DS-dda31474-047f-4e68-a9d3-258c88e6eb6e node DatanodeRegistration(127.0.0.1, datanodeUuid=156edfd6-30d3-4258-9f8d-5b25fa31f0bd, infoPort=51244, ipcPort=48392, storageInfo=lv=-56;cid=testClusterID;nsid=2144198505;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 421172 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 421178 INFO  (Thread-2186) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 421178 INFO  (Thread-2186) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 421278 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ZkTestServer start zk server on port:42291
   [junit4]   2> 421278 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 421293 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 421301 INFO  (zkCallback-550-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1637a7ce name:ZooKeeperConnection Watcher:127.0.0.1:42291 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 421302 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 421302 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 421302 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 421308 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 421325 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 421326 INFO  (zkCallback-551-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@59cbad12 name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 421326 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 421326 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 421326 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 421327 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 421327 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 421328 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 421328 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 421328 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 421329 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 421329 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 421330 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 421330 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 421331 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 421331 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 421334 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 421334 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 421334 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 421334 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 421335 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 421335 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 421335 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 421335 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 421336 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 421336 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 421337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 421337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 421337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 421337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 421405 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores/collection1
   [junit4]   2> 421408 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ef3c4a7{/ho_urd,null,AVAILABLE}
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.ServerConnector Started ServerConnector@473edeaf{HTTP/1.1,[http/1.1]}{127.0.0.1:51459}
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.Server Started @423458ms
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:38992/hdfs__localhost_38992__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001_tempDir-002_control_data, hostContext=/ho_urd, hostPort=51459, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores}
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001'
   [junit4]   2> 421424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 421425 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 421425 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 421425 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 421431 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2c574b50 name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 421431 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 421431 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 421432 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 421432 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/solr.xml
   [junit4]   2> 421435 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores
   [junit4]   2> 421436 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CoreContainer New CoreContainer 1499965252
   [junit4]   2> 421436 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001]
   [junit4]   2> 421436 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/lib
   [junit4]   2> 421436 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 421437 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 421437 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 421437 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 421441 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42291/solr
   [junit4]   2> 421441 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 421442 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 421442 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 421443 INFO  (zkCallback-555-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@303f0453 name:ZooKeeperConnection Watcher:127.0.0.1:42291 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 421443 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 421443 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 421444 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$86/693312754@456532f4
   [junit4]   2> 421445 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 421445 INFO  (zkCallback-556-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67cf7bcd name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 421446 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 421446 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 421447 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 421449 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 421450 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 421451 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 421452 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 421453 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 421454 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 421454 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 421455 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 421455 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 421456 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 421457 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 421458 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 421458 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000
   [junit4]   2> 421459 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51459_ho_urd
   [junit4]   2> 421459 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 421459 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer Overseer (id=95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) starting
   [junit4]   2> 421460 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 421464 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 421465 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51459_ho_urd
   [junit4]   2> 421465 INFO  (OverseerCollectionConfigSetProcessor-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 421466 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51459_ho_urd
   [junit4]   2> 421466 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 421467 INFO  (zkCallback-556-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 421475 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 421475 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 421475 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores
   [junit4]   2> 421476 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 421476 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores/collection1
   [junit4]   2> 421476 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 421481 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 421481 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:51459_ho_urd    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 421482 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 421485 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 421485 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 421486 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
   [junit4]   2> 421486 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [control_collection]
   [junit4]   2> 421487 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51459/ho_urd",
   [junit4]   2>   "node_name":"127.0.0.1:51459_ho_urd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 421487 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 421488 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51459/ho_urd",
   [junit4]   2>   "node_name":"127.0.0.1:51459_ho_urd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 421489 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 421489 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 421490 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 421492 INFO  (zkCallback-556-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 422489 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 422489 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 422489 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 422489 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 422490 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 422490 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores/collection1'
   [junit4]   2> 422490 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 422490 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 422491 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 422495 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 422498 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 422514 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 422518 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 422598 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 422602 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 422602 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 422608 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 422609 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 422611 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 422611 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:38992/solr_hdfs_home
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/control-001/cores/collection1], dataDir=[hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@13248cc3
   [junit4]   2> 422613 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 422645 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 422645 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 422651 WARN  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:38992/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 422652 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 422659 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 422659 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5467696557503788]
   [junit4]   2> 422723 INFO  (IPC Server handler 9 on 38992) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42103 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-2b2c137a-5359-4692-96a4-8ac420719c6d:NORMAL:127.0.0.1:48963|RBW], ReplicaUnderConstruction[[DISK]DS-4f80829f-dca2-4408-b178-7a4db69c9c4d:NORMAL:127.0.0.1:42103|RBW]]} size 0
   [junit4]   2> 422725 INFO  (IPC Server handler 7 on 38992) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48963 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4f80829f-dca2-4408-b178-7a4db69c9c4d:NORMAL:127.0.0.1:42103|RBW], ReplicaUnderConstruction[[DISK]DS-dda31474-047f-4e68-a9d3-258c88e6eb6e:NORMAL:127.0.0.1:48963|FINALIZED]]} size 0
   [junit4]   2> 422726 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29da46d4; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 422726 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 422731 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 422731 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 422731 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 422731 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 422732 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 422732 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 422732 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 422732 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 422732 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 422732 WARN  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 422733 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 422735 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 422736 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 422738 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 422744 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 422744 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 422744 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 422749 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 422749 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 422749 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 422768 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 422768 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 422769 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=2, maxMergeAtOnceExplicit=5, maxMergedSegmentMB=67.2841796875, floorSegmentMB=1.5380859375, forceMergeDeletesPctAllowed=21.61425261517323, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 422778 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@hdfs://localhost:38992/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29da46d4; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 422778 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 422778 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f5c842c[collection1] main]
   [junit4]   2> 422778 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 422780 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 422780 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 422780 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 422780 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 422780 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 422781 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 422781 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 422781 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 422781 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 422782 INFO  (searcherExecutor-1341-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5f5c842c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 422782 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 422782 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 422782 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 422782 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1534996614672809984
   [junit4]   2> 422785 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1534996614672809984
   [junit4]   2> 422785 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 422786 INFO  (coreLoadExecutor-1340-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 422788 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:51459/ho_urd collection:control_collection shard:shard1
   [junit4]   2> 422788 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 422793 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95937288312913924-core_node1-n_0000000000
   [junit4]   2> 422793 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 422795 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 422795 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 422795 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51459/ho_urd/collection1/
   [junit4]   2> 422796 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 422796 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:51459/ho_urd/collection1/ has no replicas
   [junit4]   2> 422795 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 422797 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 422798 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95937288312913924-core_node1-n_0000000000
   [junit4]   2> 422799 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:51459/ho_urd",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 422800 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51459/ho_urd/collection1/ shard1
   [junit4]   2> 422901 INFO  (zkCallback-556-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 422951 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:51459/ho_urd/collection1/ and leader is http://127.0.0.1:51459/ho_urd/collection1/
   [junit4]   2> 422951 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51459/ho_urd
   [junit4]   2> 422951 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 422951 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 422951 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 422952 INFO  (coreZkRegister-1334-thread-1-processing-n:127.0.0.1:51459_ho_urd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51459_ho_urd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 422952 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51459/ho_urd",
   [junit4]   2>   "node_name":"127.0.0.1:51459_ho_urd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 422953 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51459/ho_urd",
   [junit4]   2>   "node_name":"127.0.0.1:51459_ho_urd",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 422983 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 422983 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 423001 INFO  (zkCallback-558-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@12dd06d1 name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423001 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 423002 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 423002 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 423003 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 423003 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 423003 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 423003 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 423013 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 423014 INFO  (zkCallback-559-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e979170 name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423015 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 423015 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 423016 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 423016 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 423017 INFO  (zkCallback-558-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 423017 INFO  (zkCallback-556-thread-1-processing-n:127.0.0.1:51459_ho_urd) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 423094 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001/cores/collection1
   [junit4]   2> 423095 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001
   [junit4]   2> 423096 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 423113 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4cf4c18e{/ho_urd,null,AVAILABLE}
   [junit4]   2> 423114 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.ServerConnector Started ServerConnector@18c3de3b{HTTP/1.1,[http/1.1]}{127.0.0.1:40269}
   [junit4]   2> 423114 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.e.j.s.Server Started @425148ms
   [junit4]   2> 423114 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:38992/hdfs__localhost_38992__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/ho_urd, hostPort=40269, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001/cores}
   [junit4]   2> 423114 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 423114 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001'
   [junit4]   2> 423115 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 423115 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 423115 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 423116 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 423118 INFO  (zkCallback-560-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ae4f099 name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423118 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 423118 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 423119 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 423119 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001/solr.xml
   [junit4]   2> 423122 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001/cores
   [junit4]   2> 423123 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CoreContainer New CoreContainer 1058236940
   [junit4]   2> 423123 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001]
   [junit4]   2> 423123 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_21D3B069732F15C5-001/shard-1-001/lib
   [junit4]   2> 423124 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 423124 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 423125 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 423125 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 423125 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42291/solr
   [junit4]   2> 423125 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 423125 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 423125 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 423126 INFO  (OverseerStateUpdate-95937288312913924-127.0.0.1:51459_ho_urd-n_0000000000) [n:127.0.0.1:51459_ho_urd    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 423135 INFO  (zkCallback-563-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ec3fbe4 name:ZooKeeperConnection Watcher:127.0.0.1:42291 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423136 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 423136 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 423137 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$86/693312754@1d6d947c
   [junit4]   2> 423138 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 423139 INFO  (zkCallback-564-thread-1-processing-n:127.0.0.1:40269_ho_urd) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4b2833db name:ZooKeeperConnection Watcher:127.0.0.1:42291/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423139 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 423143 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 423144 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 423145 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[21D3B069732F15C5]) [n:127.0.0.1:40269_ho_urd    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 423145 INFO  (TEST-HdfsCollectionsAPIDis

[...truncated too long message...]


   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4636, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38813/fw_w/g: collection already exists: awholynewstresscollection_collection5_1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([21D3B069732F15C5]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1616)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:990)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4634, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38813/fw_w/g: Could not find collection : awholynewstresscollection_collection3_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([21D3B069732F15C5]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4631, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38813/fw_w/g: Could not find collection : awholynewstresscollection_collection0_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([21D3B069732F15C5]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)
   [junit4]   2> 1279007 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[21D3B069732F15C5]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> May 22, 2016 3:28:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=MockRandom), range_facet_l_dv=Lucene50(blocksize=128), _version_=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=MockRandom), a_i1=PostingsFormat(name=Asserting), id=Lucene50(blocksize=128), range_facet_i_dv=PostingsFormat(name=Asserting), text=PostingsFormat(name=LuceneVarGapDocFreqInterval), range_facet_l=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1619, maxMBSortInHeap=6.334947260759888, sim=ClassicSimilarity, locale=et-EE, timezone=Zulu
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=175228528,total=518520832
   [junit4]   2> NOTE: All tests run in this JVM: [TestOverriddenPrefixQueryForCustomFieldType, TestClusterStateMutator, TestFilteredDocIdSet, SpatialFilterTest, TestCollationFieldDocValues, TestHashPartitioner, RecoveryAfterSoftCommitTest, TestLFUCache, TestFreeTextSuggestions, TestWordDelimiterFilterFactory, SortByFunctionTest, TestSimpleTrackingShardHandler, ConfigSetsAPITest, CdcrUpdateLogTest, TestChildDocTransformer, PreAnalyzedUpdateProcessorTest, TestQueryTypes, TestSha256AuthenticationProvider, TestCloudInspectUtil, TestConfigSetImmutable, ZkCLITest, ChangedSchemaMergeTest, OpenExchangeRatesOrgProviderTest, TestSolrCLIRunExample, TestCodecSupport, OpenCloseCoreStressTest, TestSurroundQueryParser, TestBinaryResponseWriter, TestSolrQueryParserDefaultOperatorResource, DistanceUnitsTest, DocExpirationUpdateProcessorFactoryTest, TestAuthorizationFramework, EnumFieldTest, ShardRoutingTest, TestSolrDeletionPolicy2, SharedFSAutoReplicaFailoverUtilsTest, DistributedMLTComponentTest, TestUpdate, CoreMergeIndexesAdminHandlerTest, TestAddFieldRealTimeGet, AddSchemaFieldsUpdateProcessorFactoryTest, TestTrackingShardHandlerFactory, SchemaVersionSpecificBehaviorTest, MergeStrategyTest, ConvertedLegacyTest, HdfsRecoverLeaseTest, DocValuesTest, TestDistribIDF, DistributedQueueTest, TestSchemaSimilarityResource, NumericFieldsTest, TestAnalyzeInfixSuggestions, SolrIndexConfigTest, BlockJoinFacetRandomTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [138/584 (2!)] on J1 in 282.88s, 1 test, 1 error <<< FAILURES!

[...truncated 1421 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2340 tests, 2 errors, 31 ignored (16 assumptions) [seed: 21D3B069732F15C5]

Total time: 176 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 15 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/15/

17 tests failed.
FAILED:  org.apache.solr.DistributedIntervalFacetingTest.test

Error Message:
IOException occured when talking to server at: https://127.0.0.1:36307/xsdjw/w/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36307/xsdjw/w/collection1
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
	at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:547)
	at org.apache.solr.DistributedIntervalFacetingTest.test(DistributedIntervalFacetingTest.java:43)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1018)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 49 more


FAILED:  org.apache.solr.cloud.AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:55411, https://127.0.0.1:52104, https://127.0.0.1:40710]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:55411, https://127.0.0.1:52104, https://127.0.0.1:40710]
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:E5A23ECD492A444]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
	at org.apache.solr.cloud.AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse(AsyncCallRequestStatusResponseTest.java:35)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:40710
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 47 more
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 51 more


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
expected:<0> but was:<1396>

Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1396>
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:146)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.ConfigSetsAPITest.testConfigSetDeleteWhenInUse

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:36691/x_q/so, https://127.0.0.1:33321/x_q/so, https://127.0.0.1:58145/x_q/so, https://127.0.0.1:33525/x_q/so, https://127.0.0.1:36372/x_q/so]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:36691/x_q/so, https://127.0.0.1:33321/x_q/so, https://127.0.0.1:58145/x_q/so, https://127.0.0.1:33525/x_q/so, https://127.0.0.1:36372/x_q/so]
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:94A349B88661FD36]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
	at org.apache.solr.cloud.ConfigSetsAPITest.testConfigSetDeleteWhenInUse(ConfigSetsAPITest.java:38)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36372/x_q/so
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 47 more
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 51 more


FAILED:  org.apache.solr.cloud.DistribCursorPagingTest.test

Error Message:
IOException occured when talking to server at: https://127.0.0.1:43791/wgax/bl/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:43791/wgax/bl/collection1
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:831)
	at org.apache.solr.cloud.DistribCursorPagingTest.doBadInputTest(DistribCursorPagingTest.java:112)
	at org.apache.solr.cloud.DistribCursorPagingTest.test(DistribCursorPagingTest.java:86)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 50 more


FAILED:  org.apache.solr.cloud.DistribJoinFromCollectionTest.test

Error Message:
IOException occured when talking to server at: https://127.0.0.1:59280/pul

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:59280/pul
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1592)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1549)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1604)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1545)
	at org.apache.solr.cloud.DistribJoinFromCollectionTest.test(DistribJoinFromCollectionTest.java:79)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 49 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestCloudDeleteByQuery

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:36873/solr, https://127.0.0.1:56666/solr, https://127.0.0.1:40310/solr, https://127.0.0.1:53436/solr, https://127.0.0.1:38157/solr]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:36873/solr, https://127.0.0.1:56666/solr, https://127.0.0.1:40310/solr, https://127.0.0.1:53436/solr, https://127.0.0.1:38157/solr]
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.MiniSolrCloudCluster.makeCollectionsRequest(MiniSolrCloudCluster.java:415)
	at org.apache.solr.cloud.MiniSolrCloudCluster.createCollection(MiniSolrCloudCluster.java:399)
	at org.apache.solr.cloud.TestCloudDeleteByQuery.createMiniSolrCloudCluster(TestCloudDeleteByQuery.java:106)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:36873/solr
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 31 more
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 35 more


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:48549/solr, https://127.0.0.1:54574/solr, https://127.0.0.1:57814/solr]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:48549/solr, https://127.0.0.1:54574/solr, https://127.0.0.1:57814/solr]
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:A8E1923402889857]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.MiniSolrCloudCluster.makeCollectionsRequest(MiniSolrCloudCluster.java:415)
	at org.apache.solr.cloud.MiniSolrCloudCluster.createCollection(MiniSolrCloudCluster.java:399)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:206)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:181)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithNodeReplacement(TestMiniSolrCloudClusterSSL.java:145)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth(TestMiniSolrCloudClusterSSL.java:117)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:54574/solr
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 49 more
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 53 more


FAILED:  org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndClientAuth

Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:47243/solr, https://127.0.0.1:60459/solr, https://127.0.0.1:53762/solr]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:47243/solr, https://127.0.0.1:60459/solr, https://127.0.0.1:53762/solr]
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:87DFAFCD68657261]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.MiniSolrCloudCluster.makeCollectionsRequest(MiniSolrCloudCluster.java:415)
	at org.apache.solr.cloud.MiniSolrCloudCluster.createCollection(MiniSolrCloudCluster.java:399)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:206)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:181)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithNodeReplacement(TestMiniSolrCloudClusterSSL.java:145)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.testSslAndClientAuth(TestMiniSolrCloudClusterSSL.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:53762/solr
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 49 more
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 53 more


FAILED:  org.apache.solr.cloud.TestShortCircuitedRequests.test

Error Message:
IOException occured when talking to server at: https://127.0.0.1:44941/cy/q/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:44941/cy/q/collection1
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.indexDoc(AbstractFullDistribZkTestBase.java:771)
	at org.apache.solr.BaseDistributedSearchTestCase.index(BaseDistributedSearchTestCase.java:483)
	at org.apache.solr.cloud.TestShortCircuitedRequests.test(TestShortCircuitedRequests.java:39)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 48 more


FAILED:  org.apache.solr.handler.TestReqParamsAPI.test

Error Message:
Connection reset

Stack Trace:
java.net.SocketException: Connection reset
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.solr.util.RestTestHarness.getResponse(RestTestHarness.java:207)
	at org.apache.solr.util.RestTestHarness.post(RestTestHarness.java:147)
	at org.apache.solr.core.TestSolrConfigHandler.runConfigCommand(TestSolrConfigHandler.java:172)
	at org.apache.solr.handler.TestReqParamsAPI.testReqParams(TestReqParamsAPI.java:87)
	at org.apache.solr.handler.TestReqParamsAPI.test(TestReqParamsAPI.java:67)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.admin.CoreAdminHandlerTest.testDeleteInstanceDir

Error Message:
IOException occured when talking to server at: https://127.0.0.1:60741/solr/corex

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:60741/solr/corex
	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:3FC07A99AE1EFCDF]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
	at org.apache.solr.handler.admin.CoreAdminHandlerTest.testDeleteInstanceDir(CoreAdminHandlerTest.java:262)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 46 more


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.admin.CoreAdminHandlerTest

Error Message:
14 threads leaked from SUITE scope at org.apache.solr.handler.admin.CoreAdminHandlerTest:     1) Thread[id=512, name=Scheduler-1996638641, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=501, name=qtp1761659319-501, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=499, name=qtp1761659319-499, state=RUNNABLE, group=TGRP-CoreAdminHandlerTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:233)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:181)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:171)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:156)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=504, name=org.eclipse.jetty.server.session.HashSessionManager@63327f5bTimer, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=496, name=qtp1761659319-496, state=RUNNABLE, group=TGRP-CoreAdminHandlerTest]         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:233)         at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:181)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:171)         at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:102)         at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:137)         at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)         at java.lang.Thread.run(Thread.java:745)    6) Thread[id=495, name=qtp1761659319-495, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)         at java.lang.Thread.run(Thread.java:745)    7) Thread[id=502, name=qtp1761659319-502, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)         at java.lang.Thread.run(Thread.java:745)    8) Thread[id=508, name=coreContainerWorkExecutor-227-thread-1, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    9) Thread[id=506, name=Thread-138, state=WAITING, group=TGRP-CoreAdminHandlerTest]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:502)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:1247)   10) Thread[id=498, name=qtp1761659319-498, state=TIMED_WAITING, group=TGRP-CoreAdminHandlerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)         at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:546)         at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:47)         at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:609)         at java.lang.Thread.run(Thread.java:745)   11) Thread[id=

[...truncated too long message...]

    ] o.e.j.s.ServerConnector Stopped ServerConnector@462a7f88{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2358858 INFO  (TEST-DistribCursorPagingTest.test-seed#[545B4600FAA8299D]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@556b7c71{/wgax/bl,null,UNAVAILABLE}
   [junit4]   2> 2358860 INFO  (TEST-DistribCursorPagingTest.test-seed#[545B4600FAA8299D]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34636 34636
   [junit4]   2> 2358992 INFO  (Thread-11949) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34636 34636
   [junit4]   2> 2358993 WARN  (Thread-11949) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 	3	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DistribCursorPagingTest -Dtests.method=test -Dtests.seed=545B4600FAA8299D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sq -Dtests.timezone=America/Costa_Rica -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   23.4s J1 | DistribCursorPagingTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:43791/wgax/bl/collection1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([545B4600FAA8299D:DC0F79DA54544465]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.del(AbstractFullDistribZkTestBase.java:831)
   [junit4]    > 	at org.apache.solr.cloud.DistribCursorPagingTest.doBadInputTest(DistribCursorPagingTest.java:112)
   [junit4]    > 	at org.apache.solr.cloud.DistribCursorPagingTest.test(DistribCursorPagingTest.java:86)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.net.SocketException: Connection reset
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:209)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    > 	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
   [junit4]    > 	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
   [junit4]    > 	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
   [junit4]    > 	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
   [junit4]    > 	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
   [junit4]    > 	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
   [junit4]    > 	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:543)
   [junit4]    > 	at org.apache.http.conn.ssl.SSLSocketFactory.connectSocket(SSLSocketFactory.java:409)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:177)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
   [junit4]    > 	... 50 more
   [junit4]   2> 2358995 INFO  (SUITE-DistribCursorPagingTest-seed#[545B4600FAA8299D]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.DistribCursorPagingTest_545B4600FAA8299D-001
   [junit4]   2> May 21, 2016 3:38:53 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60), sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=sq, timezone=America/Costa_Rica
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=223658104,total=507510784
   [junit4]   2> NOTE: All tests run in this JVM: [AsyncMigrateRouteKeyTest, TestEmbeddedSolrServerConstructors, TestLFUCache, SolrCmdDistributorTest, RestartWhileUpdatingTest, TestPerFieldSimilarityWithDefaultOverride, WrapperMergePolicyFactoryTest, IndexBasedSpellCheckerTest, TestComplexPhraseQParserPlugin, TestCursorMarkWithoutUniqueKey, SmileWriterTest, LoggingHandlerTest, TestRebalanceLeaders, OverseerRolesTest, TestBulkSchemaAPI, TestJsonFacets, UpdateRequestProcessorFactoryTest, TestSortByMinMaxFunction, BlockDirectoryTest, TestConfigReload, EnumFieldTest, SimplePostToolTest, DistributedIntervalFacetingTest, ZkControllerTest, TestTrie, DistributedFacetPivotSmallTest, TestAddFieldRealTimeGet, TestOverriddenPrefixQueryForCustomFieldType, MultiTermTest, ChaosMonkeySafeLeaderTest, TestDFRSimilarityFactory, ChangedSchemaMergeTest, MBeansHandlerTest, FullHLLTest, DistanceFunctionTest, OpenExchangeRatesOrgProviderTest, TestRequestStatusCollectionAPI, TestLMJelinekMercerSimilarityFactory, TestDistributedStatsComponentCardinality, TestFastLRUCache, SolrXmlInZkTest, TestAnalyzeInfixSuggestions, SpellCheckCollatorTest, HdfsBasicDistributedZk2Test, TestExclusionRuleCollectionAccess, ConfigSetsAPITest, ConvertedLegacyTest, OpenCloseCoreStressTest, HdfsSyncSliceTest, TestFilteredDocIdSet, DirectSolrSpellCheckerTest, SolrInfoMBeanTest, WordBreakSolrSpellCheckerTest, CollectionsAPIAsyncDistributedZkTest, TestScoreJoinQPNoScore, TestSolrQueryParserDefaultOperatorResource, DistributedFacetPivotLargeTest, HighlighterTest, TestDistribIDF, SpellCheckComponentTest, NumericFieldsTest, ChaosMonkeyNothingIsSafeTest, TestReloadDeadlock, TestDefaultSearchFieldResource, UniqFieldsUpdateProcessorFactoryTest, SegmentsInfoRequestHandlerTest, CollectionsAPIDistributedZkTest, TestSolrXml, TestMiniSolrCloudClusterSSL, TestDistributedGrouping, CollectionReloadTest, TestBM25SimilarityFactory, BasicFunctionalityTest, TestFieldTypeResource, TestBinaryResponseWriter, DistribCursorPagingTest]
   [junit4] Completed [561/584 (14!)] on J1 in 24.18s, 1 test, 1 error <<< FAILURES!

[...truncated 92 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2334 tests, 4 suite-level errors, 12 errors, 1 failure, 1520 ignored (6 assumptions) [seed: 545B4600FAA8299D]

Total time: 156 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 14 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/14/

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CreateCollectionCleanupTest

Error Message:
Path /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/configsets/cloud-minimal/conf does not exist

Stack Trace:
java.io.IOException: Path /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/configsets/cloud-minimal/conf does not exist
	at __randomizedtesting.SeedInfo.seed([B34FB5EE74F2FB]:0)
	at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57)
	at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.uploadConfig(CloudSolrClient.java:527)
	at org.apache.solr.cloud.SolrCloudTestCase$Builder.configure(SolrCloudTestCase.java:131)
	at org.apache.solr.cloud.CreateCollectionCleanupTest.createCluster(CreateCollectionCleanupTest.java:64)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.RollingRestartTest.test

Error Message:
Unable to restart (#4): CloudJettyRunner [url=https://127.0.0.1:42204/y_jr/uv/collection1]

Stack Trace:
java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=https://127.0.0.1:42204/y_jr/uv/collection1]
	at __randomizedtesting.SeedInfo.seed([B34FB5EE74F2FB:88E7706F40889F03]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:103)
	at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 5 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 5 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([B34FB5EE74F2FB]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
	at sun.reflect.GeneratedMethodAccessor47.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11258 lines...]
   [junit4] Suite: org.apache.solr.cloud.CreateCollectionCleanupTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/init-core-data-001
   [junit4]   2> 683892 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 683893 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 683893 INFO  (Thread-8023) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 683893 INFO  (Thread-8023) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 683993 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:54365
   [junit4]   2> 683993 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 683993 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 683995 INFO  (zkCallback-238-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3be3ee67 name:ZooKeeperConnection Watcher:127.0.0.1:54365 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 683995 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 683995 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 683995 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 683998 INFO  (jetty-launcher-237-thread-1) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 684016 INFO  (jetty-launcher-237-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@726a2ec8{/solr,null,AVAILABLE}
   [junit4]   2> 684017 INFO  (jetty-launcher-237-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@60195690{HTTP/1.1,[http/1.1]}{127.0.0.1:38883}
   [junit4]   2> 684017 INFO  (jetty-launcher-237-thread-1) [    ] o.e.j.s.Server Started @686591ms
   [junit4]   2> 684017 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38883}
   [junit4]   2> 684018 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 684018 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/tempDir-001/node1'
   [junit4]   2> 684018 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 684018 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 684018 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 684018 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 684019 INFO  (zkCallback-239-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@138dbb30 name:ZooKeeperConnection Watcher:127.0.0.1:54365/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684019 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 684020 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 684020 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 684024 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/tempDir-001/node1/.
   [junit4]   2> 684025 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 201105903
   [junit4]   2> 684025 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/tempDir-001/node1]
   [junit4]   2> 684026 WARN  (jetty-launcher-237-thread-1) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/tempDir-001/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/tempDir-001/node1/lib
   [junit4]   2> 684026 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54365/solr
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 684027 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 684035 INFO  (zkCallback-242-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a4151 name:ZooKeeperConnection Watcher:127.0.0.1:54365 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684036 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 684036 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 684037 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$38/511580936@508b69b1
   [junit4]   2> 684039 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 684044 INFO  (zkCallback-243-thread-1-processing-n:127.0.0.1:38883_solr) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@71869d2b name:ZooKeeperConnection Watcher:127.0.0.1:54365/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684044 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 684046 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 684047 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 684048 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 684048 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 684049 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 684050 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 684050 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 684051 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 684051 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 684052 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 684052 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 684052 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 684053 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 684053 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 684054 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 684054 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95925571615850499-127.0.0.1:38883_solr-n_0000000000
   [junit4]   2> 684054 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38883_solr
   [junit4]   2> 684054 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 684055 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.Overseer Overseer (id=95925571615850499-127.0.0.1:38883_solr-n_0000000000) starting
   [junit4]   2> 684055 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 684057 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 684058 INFO  (OverseerCollectionConfigSetProcessor-95925571615850499-127.0.0.1:38883_solr-n_0000000000) [n:127.0.0.1:38883_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 684058 INFO  (OverseerStateUpdate-95925571615850499-127.0.0.1:38883_solr-n_0000000000) [n:127.0.0.1:38883_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 684067 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38883_solr
   [junit4]   2> 684068 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38883_solr
   [junit4]   2> 684068 INFO  (OverseerStateUpdate-95925571615850499-127.0.0.1:38883_solr-n_0000000000) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 684069 INFO  (zkCallback-243-thread-1-processing-n:127.0.0.1:38883_solr) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 684082 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 684082 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 684083 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CreateCollectionCleanupTest_B34FB5EE74F2FB-001/tempDir-001/node1/.
   [junit4]   2> 684083 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 684083 INFO  (zkCallback-243-thread-1-processing-n:127.0.0.1:38883_solr) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 684083 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 684083 INFO  (jetty-launcher-237-thread-1) [n:127.0.0.1:38883_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 684083 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 684099 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 684115 INFO  (zkCallback-244-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27e31a21 name:ZooKeeperConnection Watcher:127.0.0.1:54365 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684115 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 684116 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 684117 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 684117 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 684126 INFO  (zkCallback-246-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53ceb8c0 name:ZooKeeperConnection Watcher:127.0.0.1:54365/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 684126 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 684126 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 684126 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 684127 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 684129 INFO  (jetty-launcher-237-thread-1) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@60195690{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 684129 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=201105903
   [junit4]   2> 684129 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.ZkController Publish node=127.0.0.1:38883_solr as DOWN
   [junit4]   2> 684130 INFO  (OverseerStateUpdate-95925571615850499-127.0.0.1:38883_solr-n_0000000000) [n:127.0.0.1:38883_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:38883_solr"} current state version: 0
   [junit4]   2> 684130 INFO  (OverseerStateUpdate-95925571615850499-127.0.0.1:38883_solr-n_0000000000) [n:127.0.0.1:38883_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:38883_solr
   [junit4]   2> 684131 INFO  (jetty-launcher-237-thread-1) [    ] o.a.s.c.Overseer Overseer (id=95925571615850499-127.0.0.1:38883_solr-n_0000000000) closing
   [junit4]   2> 684131 INFO  (OverseerStateUpdate-95925571615850499-127.0.0.1:38883_solr-n_0000000000) [n:127.0.0.1:38883_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38883_solr
   [junit4]   2> 684135 INFO  (zkCallback-243-thread-1-processing-n:127.0.0.1:38883_solr) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 684135 WARN  (zkCallback-243-thread-1-processing-n:127.0.0.1:38883_solr) [n:127.0.0.1:38883_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 684141 INFO  (jetty-launcher-237-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@726a2ec8{/solr,null,UNAVAILABLE}
   [junit4]   2> 684144 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54365 54365
   [junit4]   2> 684270 INFO  (Thread-8023) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54365 54365
   [junit4]   2> 684271 WARN  (Thread-8023) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> 684271 INFO  (SUITE-CreateCollectionCleanupTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> May 20, 2016 1:34:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1672, maxMBSortInHeap=6.516428604407633, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=es-PY, timezone=Asia/Oral
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=167733976,total=386924544
   [junit4]   2> NOTE: All tests run in this JVM: [TestLRUStatsCache, ReplicationFactorTest, DefaultValueUpdateProcessorTest, TestLuceneMatchVersion, HdfsBasicDistributedZk2Test, TestSolrCLIRunExample, TestManagedResource, ZkNodePropsTest, TestLMDirichletSimilarityFactory, TestBulkSchemaAPI, LeaderInitiatedRecoveryOnCommitTest, DistributedQueryComponentOptimizationTest, TestFastOutputStream, TestFreeTextSuggestions, BlockJoinFacetRandomTest, TestJsonFacets, TlogReplayBufferedWhileIndexingTest, ActionThrottleTest, TestBadConfig, TestSolrXml, CreateCollectionCleanupTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CreateCollectionCleanupTest -Dtests.seed=B34FB5EE74F2FB -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es-PY -Dtests.timezone=Asia/Oral -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | CreateCollectionCleanupTest (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Path /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/configsets/cloud-minimal/conf does not exist
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B34FB5EE74F2FB]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkConfigManager.uploadToZK(ZkConfigManager.java:57)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkConfigManager.uploadConfigDir(ZkConfigManager.java:121)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.uploadConfig(CloudSolrClient.java:527)
   [junit4]    > 	at org.apache.solr.cloud.SolrCloudTestCase$Builder.configure(SolrCloudTestCase.java:131)
   [junit4]    > 	at org.apache.solr.cloud.CreateCollectionCleanupTest.createCluster(CreateCollectionCleanupTest.java:64)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed [107/583 (1!)] on J0 in 1.14s, 0 tests, 1 error <<< FAILURES!

[...truncated 988 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/init-core-data-001
   [junit4]   2> 1850329 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestIndexFetchWithMasterUrl
   [junit4]   2> 1850330 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1
   [junit4]   2> 1850332 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1850333 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b37da60{/solr,null,AVAILABLE}
   [junit4]   2> 1850333 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@100c4f6d{HTTP/1.1,[http/1.1]}{127.0.0.1:34862}
   [junit4]   2> 1850333 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.Server Started @1852907ms
   [junit4]   2> 1850333 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=34862}
   [junit4]   2> 1850333 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1850333 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001'
   [junit4]   2> 1850334 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1850334 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1850334 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/solr.xml
   [junit4]   2> 1850337 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/.
   [junit4]   2> 1850337 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer New CoreContainer 464918424
   [junit4]   2> 1850337 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001]
   [junit4]   2> 1850337 WARN  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/lib
   [junit4]   2> 1850337 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1850338 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1850338 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1850338 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1850338 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1850338 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1850339 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/.
   [junit4]   2> 1850340 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1850340 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1
   [junit4]   2> 1850340 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1850340 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1'
   [junit4]   2> 1850340 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 1850340 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1850340 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1850340 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1850344 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1850346 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 1850350 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1850352 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1850354 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1'
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1/data
   [junit4]   2> 1850355 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1/data/index/
   [junit4]   2> 1850356 WARN  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1850356 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 1850356 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1d38833a
   [junit4]   2> 1850356 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@129d4548 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6dd7f5a0),segFN=segments_1,generation=1}
   [junit4]   2> 1850356 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1850356 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/./collection1/data/
   [junit4]   2> 1850357 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1850358 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850359 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850359 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850359 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850360 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 1850360 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1850360 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1850360 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1850360 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1850360 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=43.7333984375, floorSegmentMB=1.3740234375, forceMergeDeletesPctAllowed=11.017773811516369, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20156855156679906
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@129d4548 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6dd7f5a0),segFN=segments_1,generation=1}
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5f3e7c79[collection1] main]
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1/conf
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1/conf}
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-001/collection1/conf
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1850361 INFO  (searcherExecutor-4962-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5f3e7c79[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1850361 INFO  (coreLoadExecutor-4961-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1850841 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1
   [junit4]   2> 1850843 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1850844 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@378540d8{/solr,null,AVAILABLE}
   [junit4]   2> 1850844 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@17da5ecc{HTTP/1.1,[http/1.1]}{127.0.0.1:41465}
   [junit4]   2> 1850844 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.Server Started @1853418ms
   [junit4]   2> 1850844 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=41465}
   [junit4]   2> 1850845 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1850845 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002'
   [junit4]   2> 1850845 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1850845 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1850845 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/solr.xml
   [junit4]   2> 1850848 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/.
   [junit4]   2> 1850848 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer New CoreContainer 258478384
   [junit4]   2> 1850848 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002]
   [junit4]   2> 1850848 WARN  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/lib
   [junit4]   2> 1850848 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1850854 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1850854 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1850855 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1850855 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1850855 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1850855 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/.
   [junit4]   2> 1850856 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1850856 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1
   [junit4]   2> 1850856 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1850857 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1'
   [junit4]   2> 1850858 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1850858 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1850858 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 1850858 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1850860 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1850863 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 1850867 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1850868 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1850870 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1850870 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1'
   [junit4]   2> 1850870 INFO  (coreLoadExecutor-4971-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1
   [junit4]   2> 1850870 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 1850871 WARN  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1165aa41
   [junit4]   2> 1850871 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@e3cc849 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5151c08f),segFN=segments_1,generation=1}
   [junit4]   2> 1850872 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1850872 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1850873 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1850873 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850874 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850874 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850874 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1850875 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 1850875 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1850875 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1850875 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1850875 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1850875 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=43.7333984375, floorSegmentMB=1.3740234375, forceMergeDeletesPctAllowed=11.017773811516369, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20156855156679906
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@e3cc849 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5151c08f),segFN=segments_1,generation=1}
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@39c9b262[collection1] main]
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/conf
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/conf}
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/conf
   [junit4]   2> 1850876 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1850877 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms
   [junit4]   2> 1850877 INFO  (searcherExecutor-4972-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@39c9b262[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1850879 INFO  (coreLoadExecutor-4971-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1850881 INFO  (qtp1206074389-27320) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1851359 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@17da5ecc{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1851359 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=258478384
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1df0e4c
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index;done=false>>]
   [junit4]   2> 1851360 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 1851361 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data;done=false>>]
   [junit4]   2> 1851361 INFO  (coreCloseExecutor-4977-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data
   [junit4]   2> 1851361 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@378540d8{/solr,null,UNAVAILABLE}
   [junit4]   2> 1851363 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@40711e4a{/solr,null,AVAILABLE}
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@108fabd7{HTTP/1.1,[http/1.1]}{127.0.0.1:57937}
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.e.j.s.Server Started @1853938ms
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=57937}
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002'
   [junit4]   2> 1851364 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1851365 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1851365 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/solr.xml
   [junit4]   2> 1851367 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/.
   [junit4]   2> 1851367 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer New CoreContainer 1331469939
   [junit4]   2> 1851367 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002]
   [junit4]   2> 1851368 WARN  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/lib
   [junit4]   2> 1851368 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1851368 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1851368 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1851368 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1851369 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1851369 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1851369 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/.
   [junit4]   2> 1851369 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1851369 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1
   [junit4]   2> 1851369 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1851370 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 1851370 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[B34FB5EE74F2FB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1851370 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1'
   [junit4]   2> 1851370 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1851370 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1851373 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1851375 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 1851378 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1851380 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1851394 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1'
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data
   [junit4]   2> 1851396 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 1851396 WARN  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1851397 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 1851397 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@439a4f10
   [junit4]   2> 1851397 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3560927 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2621d03f),segFN=segments_1,generation=1}
   [junit4]   2> 1851397 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1851397 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1851398 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1851399 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1851399 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1851400 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1851400 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1851402 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 1851403 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1851403 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1851403 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=43.7333984375, floorSegmentMB=1.3740234375, forceMergeDeletesPctAllowed=11.017773811516369, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20156855156679906
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3560927 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2621d03f),segFN=segments_1,generation=1}
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@49b6693[collection1] main]
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/conf
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/conf}
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_B34FB5EE74F2FB-001/solr-instance-002/collection1/conf
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1851404 INFO  (searcherExecutor-4985-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@49b6693[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1851404 INFO  (coreLoadExecutor-4984-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1851871 INFO  (qtp1206074389-27323) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1851871 INFO  (qtp1206074389-27323) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
   [junit4]   2> 1851872 INFO  (qtp435889603-27357) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1851872 INFO  (qtp435889603-27357) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
   [junit4]   2> 1851874 INFO  (qtp435889603-27358) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1851874 INFO  (qtp435889603-27358) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3560927 lockFactory=org.apache.lucene.store.SingleInstanceL

[...truncated too long message...]

ect/shard1/election/95925737565519956-core_node12-n_0000000015
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565520034-127.0.0.1:44441_y_jr%2Fuv-n_0000000068
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565519986-core_node8-n_0000000019
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565519974-core_node14-n_0000000017
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565520028-127.0.0.1:49421_y_jr%2Fuv-n_0000000066
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565519929-127.0.0.1:57171_y_jr%2Fuv-n_0000000022
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565519992-127.0.0.1:47066_y_jr%2Fuv-n_0000000049
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565519884-core_node2-n_0000000000
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard2/election/95925737565520109-core_node13-n_0000000029
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565520004-core_node12-n_0000000025
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565519877-127.0.0.1:40014_y_jr%2Fuv-n_0000000017
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565519998-core_node2-n_0000000023
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565520046-127.0.0.1:57308_y_jr%2Fuv-n_0000000072
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565520136-127.0.0.1:47066_y_jr%2Fuv-n_0000000112
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565520094-127.0.0.1:57308_y_jr%2Fuv-n_0000000093
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565519998-127.0.0.1:57308_y_jr%2Fuv-n_0000000051
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565520040-127.0.0.1:47066_y_jr%2Fuv-n_0000000070
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565520070-core_node14-n_0000000037
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565520034-core_node8-n_0000000029
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565519992-core_node4-n_0000000021
   [junit4]   2> 	2	/solr/overseer_elect/election/95925737565519944-127.0.0.1:47066_y_jr%2Fuv-n_0000000028
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/95925737565520088-core_node4-n_0000000041
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard2/election/95925737565520025-core_node5-n_0000000020
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	90	/solr/collections
   [junit4]   2> 	39	/solr/overseer/collection-queue-work
   [junit4]   2> 	37	/solr/overseer/queue
   [junit4]   2> 	18	/solr/live_nodes
   [junit4]   2> 	5	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=B34FB5EE74F2FB -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=pl-PL -Dtests.timezone=Africa/Mogadishu -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE  570s J1 | RollingRestartTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=https://127.0.0.1:42204/y_jr/uv/collection1]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B34FB5EE74F2FB:88E7706F40889F03]:0)
   [junit4]    > 	at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:103)
   [junit4]    > 	at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 3785334 INFO  (SUITE-RollingRestartTest-seed#[B34FB5EE74F2FB]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_B34FB5EE74F2FB-001
   [junit4]   2> May 20, 2016 2:26:04 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1685, maxMBSortInHeap=5.665379635518238, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=pl-PL, timezone=Africa/Mogadishu
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=140916440,total=513802240
   [junit4]   2> NOTE: All tests run in this JVM: [CSVRequestHandlerTest, TestQuerySenderListener, TestDistributedGrouping, TestTestInjection, RestartWhileUpdatingTest, TestSearcherReuse, HdfsCollectionsAPIDistributedZkTest, TestUseDocValuesAsStored, ChaosMonkeySafeLeaderTest, TestImplicitCoreProperties, TestReRankQParserPlugin, TestManagedSynonymFilterFactory, MultiTermTest, TestLFUCache, RuleEngineTest, TestCustomDocTransformer, TestTrie, TestSimpleTrackingShardHandler, DistributedTermsComponentTest, DocValuesTest, TestDynamicFieldCollectionResource, TestNamedUpdateProcessors, SpatialRPTFieldTypeTest, SolrInfoMBeanTest, TestFastLRUCache, TestCodecSupport, DirectoryFactoryTest, TestRequestStatusCollectionAPI, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SpellingQueryConverterTest, LoggingHandlerTest, TermVectorComponentTest, DistributedSuggestComponentTest, TestFiltering, BasicFunctionalityTest, TestMiniSolrCloudCluster, RankQueryTest, MBeansHandlerTest, TermsComponentTest, ResponseHeaderTest, TestPKIAuthenticationPlugin, RequestLoggingTest, DataDrivenBlockJoinTest, SolrXmlInZkTest, CustomCollectionTest, DOMUtilTest, MinimalSchemaTest, OpenCloseCoreStressTest, DirectSolrSpellCheckerTest, ZkSolrClientTest, TestSolrQueryResponse, TestSolrDeletionPolicy2, BasicAuthIntegrationTest, TestFieldResource, DocumentBuilderTest, TestManagedResourceStorage, NumericFieldsTest, DistribCursorPagingTest, TestSolrCloudWithKerberosAlt, TestRebalanceLeaders, TestSQLHandler, TestQueryTypes, OverseerRolesTest, HttpPartitionTest, ShardRoutingCustomTest, ZkStateReaderTest, CheckHdfsIndexTest, TestSchemaVersionResource, SimpleMLTQParserTest, TestNRTOpen, TestSolr4Spatial2, TestCryptoKeys, ChaosMonkeyNothingIsSafeTest, InfoHandlerTest, TestIntervalFaceting, TestObjectReleaseTracker, TestExpandComponent, TimeZoneUtilsTest, TestUpdate, RecoveryAfterSoftCommitTest, TestMiniSolrCloudClusterSSL, TestDocumentBuilder, UniqFieldsUpdateProcessorFactoryTest, TestTrieFacet, HdfsThreadLeakTest, SolrCmdDistributorTest, TestReplicationHandlerBackup, TestHashPartitioner, TestHighFrequencyDictionaryFactory, SimplePostToolTest, SchemaVersionSpecificBehaviorTest, TestBlendedInfixSuggestions, TestMergePolicyConfig, TestDocSet, TestElisionMultitermQuery, OutputWriterTest, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, ResourceLoaderTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, DateMathParserTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, ClusterStateTest, TestSolrJ, TestLRUCache, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, CursorPagingTest, DistributedIntervalFacetingTest, AsyncMigrateRouteKeyTest, CdcrReplicationHandlerTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, DeleteReplicaTest, DistribJoinFromCollectionTest, ForceLeaderTest, MultiThreadedOCPTest, RollingRestartTest]
   [junit4] Completed [476/583 (3!)] on J1 in 569.95s, 1 test, 1 failure <<< FAILURES!

[...truncated 352 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 583 suites (10 ignored), 2327 tests, 2 suite-level errors, 1 failure, 31 ignored (16 assumptions) [seed: B34FB5EE74F2FB]

Total time: 179 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




Re: [JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 13 - Still Failing

Posted by David Smiley <da...@gmail.com>.
I'll dig.

On Wed, May 18, 2016 at 9:45 PM Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/13/
>
> 1 tests failed.
> FAILED:
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.testRandom {
> seed=[3EC907D1784B6F23:A3439C5F68FEAB94]}
>
> Error Message:
> expected:<1> but was:<0>
>
> Stack Trace:
> java.lang.AssertionError: expected:<1> but was:<0>
>         at
> __randomizedtesting.SeedInfo.seed([3EC907D1784B6F23:A3439C5F68FEAB94]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.failNotEquals(Assert.java:647)
>         at org.junit.Assert.assertEquals(Assert.java:128)
>         at org.junit.Assert.assertEquals(Assert.java:472)
>         at org.junit.Assert.assertEquals(Assert.java:456)
>         at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.validateHeatmapResult(HeatmapFacetCounterTest.java:226)
>         at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:193)
>         at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:206)
>         at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.testRandom(HeatmapFacetCounterTest.java:172)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>         at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 9044 lines...]
>    [junit4] Suite: org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 0 cells, 0 non-zero
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 401 cells, 77 non-zero
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 18 cells, 6 non-zero
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 13 cells, 8 non-zero
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 10 cells, 5 non-zero
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 16 cells, 8 non-zero
>    [junit4]   2> maí 19, 2016 3:43:57 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 10 cells, 6 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 25 cells, 10 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 16 cells, 6 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 10 cells, 5 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 16 cells, 10 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 19 cells, 9 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 6 cells, 4 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 9 cells, 8 non-zero
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by
> running 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=HeatmapFacetCounterTest -Dtests.method=testRandom
> -Dtests.seed=3EC907D1784B6F23 -Dtests.multiplier=2 -Dtests.nightly=true
> -Dtests.slow=true
> -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt
> -Dtests.locale=is-IS -Dtests.timezone=Europe/Tirane -Dtests.asserts=true
> -Dtests.file.encoding=UTF-8
>    [junit4] FAILURE 0.04s J2 | HeatmapFacetCounterTest.testRandom {
> seed=[3EC907D1784B6F23:A3439C5F68FEAB94]} <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but
> was:<0>
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([3EC907D1784B6F23:A3439C5F68FEAB94]:0)
>    [junit4]    >        at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.validateHeatmapResult(HeatmapFacetCounterTest.java:226)
>    [junit4]    >        at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:193)
>    [junit4]    >        at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:206)
>    [junit4]    >        at
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.testRandom(HeatmapFacetCounterTest.java:172)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 13 cells, 5 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 2 cells, 2 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 11 cells, 8 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 17 cells, 13 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 8 cells, 5 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 27 cells, 4 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 12 cells, 5 non-zero
>    [junit4]   2> maí 19, 2016 3:43:58 AM
> org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
>    [junit4]   2> INFO: Validated 10 cells, 7 non-zero
>    [junit4]   2> NOTE: leaving temporary files on disk at:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build/spatial-extras/test/J2/temp/lucene.spatial.prefix.HeatmapFacetCounterTest_3EC907D1784B6F23-001
>    [junit4]   2> NOTE: test params are:
> codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
> chunkSize=3, maxDocsPerChunk=639, blockSize=10),
> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST,
> chunkSize=3, blockSize=10)), sim=ClassicSimilarity, locale=is-IS,
> timezone=Europe/Tirane
>    [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation
> 1.8.0_74 (64-bit)/cpus=4,threads=1,free=272392216,total=319291392
>    [junit4]   2> NOTE: All tests run in this JVM:
> [Geo3dShapeSphereModelRectRelationTest, HeatmapFacetCounterTest]
>    [junit4] Completed [7/22 (1!)] on J2 in 2.66s, 22 tests, 1 failure <<<
> FAILURES!
>
> [...truncated 60 lines...]
> BUILD FAILED
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build.xml:476:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:2187:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/module-build.xml:58:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457:
> The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014:
> There were test failures: 22 suites, 241 tests, 1 failure, 3 ignored (2
> assumptions) [seed: 3EC907D1784B6F23]
>
> Total time: 100 minutes 46 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> No prior successful build to compare, so performing full copy of artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

-- 
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com

[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 13 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/13/

1 tests failed.
FAILED:  org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.testRandom { seed=[3EC907D1784B6F23:A3439C5F68FEAB94]}

Error Message:
expected:<1> but was:<0>

Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
	at __randomizedtesting.SeedInfo.seed([3EC907D1784B6F23:A3439C5F68FEAB94]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.validateHeatmapResult(HeatmapFacetCounterTest.java:226)
	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:193)
	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:206)
	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.testRandom(HeatmapFacetCounterTest.java:172)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9044 lines...]
   [junit4] Suite: org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 0 cells, 0 non-zero
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 401 cells, 77 non-zero
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 18 cells, 6 non-zero
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 13 cells, 8 non-zero
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 10 cells, 5 non-zero
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 16 cells, 8 non-zero
   [junit4]   2> maí 19, 2016 3:43:57 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 10 cells, 6 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 25 cells, 10 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 16 cells, 6 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 10 cells, 5 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 16 cells, 10 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 19 cells, 9 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 6 cells, 4 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 9 cells, 8 non-zero
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HeatmapFacetCounterTest -Dtests.method=testRandom -Dtests.seed=3EC907D1784B6F23 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=is-IS -Dtests.timezone=Europe/Tirane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.04s J2 | HeatmapFacetCounterTest.testRandom { seed=[3EC907D1784B6F23:A3439C5F68FEAB94]} <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<1> but was:<0>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3EC907D1784B6F23:A3439C5F68FEAB94]:0)
   [junit4]    > 	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.validateHeatmapResult(HeatmapFacetCounterTest.java:226)
   [junit4]    > 	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:193)
   [junit4]    > 	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.queryHeatmapRecursive(HeatmapFacetCounterTest.java:206)
   [junit4]    > 	at org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest.testRandom(HeatmapFacetCounterTest.java:172)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 13 cells, 5 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 2 cells, 2 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 11 cells, 8 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 17 cells, 13 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 8 cells, 5 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 27 cells, 4 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 12 cells, 5 non-zero
   [junit4]   2> maí 19, 2016 3:43:58 AM org.apache.lucene.spatial.prefix.HeatmapFacetCounterTest after
   [junit4]   2> INFO: Validated 10 cells, 7 non-zero
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build/spatial-extras/test/J2/temp/lucene.spatial.prefix.HeatmapFacetCounterTest_3EC907D1784B6F23-001
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=3, maxDocsPerChunk=639, blockSize=10), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=3, blockSize=10)), sim=ClassicSimilarity, locale=is-IS, timezone=Europe/Tirane
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=272392216,total=319291392
   [junit4]   2> NOTE: All tests run in this JVM: [Geo3dShapeSphereModelRectRelationTest, HeatmapFacetCounterTest]
   [junit4] Completed [7/22 (1!)] on J2 in 2.66s, 22 tests, 1 failure <<< FAILURES!

[...truncated 60 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/build.xml:476: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:2187: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/module-build.xml:58: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 22 suites, 241 tests, 1 failure, 3 ignored (2 assumptions) [seed: 3EC907D1784B6F23]

Total time: 100 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 12 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/12/

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:50480/_/w

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:50480/_/w
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:382)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:440)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 47 more




Build Log:
[...truncated 11764 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/init-core-data-001
   [junit4]   2> 1767529 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[F255A4056D2F1DF]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1767529 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[F255A4056D2F1DF]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_/w
   [junit4]   2> 1767531 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1767532 INFO  (Thread-51147) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1767532 INFO  (Thread-51147) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1767632 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ZkTestServer start zk server on port:49105
   [junit4]   2> 1767632 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1767632 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767634 INFO  (zkCallback-1583-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5664daa9 name:ZooKeeperConnection Watcher:127.0.0.1:49105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767635 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767635 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1767635 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1767637 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1767637 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767638 INFO  (zkCallback-1584-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ed3f318 name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767638 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767638 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1767638 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1767639 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1767639 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1767640 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1767641 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1767641 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1767642 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1767642 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1767643 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1767643 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1767644 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1767644 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1767644 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1767644 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1767645 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1767645 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1767646 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1767646 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1767647 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1767647 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1767647 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1767648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1767648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1767648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1767649 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1767649 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1767650 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1767650 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767651 INFO  (zkCallback-1585-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f35d324 name:ZooKeeperConnection Watcher:127.0.0.1:49105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767651 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767651 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1767651 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1767652 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1767652 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767653 INFO  (zkCallback-1586-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d8affe3 name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1767653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1767653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1767654 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1767654 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1767655 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1767655 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1767656 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1767656 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1767657 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1767657 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1767658 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1767658 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1767658 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1767658 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1767659 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1767659 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1767660 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1767660 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1767661 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1767661 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1767661 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1767662 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1767662 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1767662 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1767719 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1
   [junit4]   2> 1767721 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1767721 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2fcfa503{/_/w,null,AVAILABLE}
   [junit4]   2> 1767724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.ServerConnector Started ServerConnector@34db6976{HTTP/1.1,[http/1.1]}{127.0.0.1:56161}
   [junit4]   2> 1767724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.Server Started @1770316ms
   [junit4]   2> 1767724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/tempDir-001/control/data, hostContext=/_/w, hostPort=56161, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores}
   [junit4]   2> 1767724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1767724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001'
   [junit4]   2> 1767725 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1767725 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1767725 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1767728 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767729 INFO  (zkCallback-1587-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f23fcb2 name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767729 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767729 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1767730 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1767730 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/solr.xml
   [junit4]   2> 1767733 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores
   [junit4]   2> 1767733 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CoreContainer New CoreContainer 1916264700
   [junit4]   2> 1767733 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001]
   [junit4]   2> 1767733 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/lib
   [junit4]   2> 1767733 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1767734 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1767734 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1767734 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1767735 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49105/solr
   [junit4]   2> 1767735 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1767735 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1767740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767740 INFO  (zkCallback-1590-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4b362bbc name:ZooKeeperConnection Watcher:127.0.0.1:49105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767741 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767741 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1767742 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1767742 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f74ca59 name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1767742 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1767743 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1767744 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1767745 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1767745 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1767746 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1767747 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1767747 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1767748 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1767748 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1767749 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1767749 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1767750 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1767750 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1767751 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1767751 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000
   [junit4]   2> 1767751 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56161__%2Fw
   [junit4]   2> 1767751 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1767752 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer Overseer (id=95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) starting
   [junit4]   2> 1767753 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1767755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1767755 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1767756 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1767756 INFO  (OverseerCollectionConfigSetProcessor-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1767757 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56161__%2Fw
   [junit4]   2> 1767757 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56161__%2Fw
   [junit4]   2> 1767758 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1767760 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1767771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1767771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1767771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores
   [junit4]   2> 1767772 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1767772 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1
   [junit4]   2> 1767772 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1767773 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1767773 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 1767773 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1767773 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:56161__%2Fw    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1767773 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56161/_/w",
   [junit4]   2>   "node_name":"127.0.0.1:56161__%2Fw",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1767773 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1767774 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56161/_/w",
   [junit4]   2>   "node_name":"127.0.0.1:56161__%2Fw",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1767774 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1767774 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1767775 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1768774 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1768774 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1768774 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1768774 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1768775 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1768775 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1'
   [junit4]   2> 1768775 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1768775 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1768776 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1768779 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1768782 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 1768797 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1768800 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1768853 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1768856 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1768863 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1768867 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1768868 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1768869 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1768870 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data/]
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a4a7c26
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data
   [junit4]   2> 1768871 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1768872 WARN  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1768872 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data/index
   [junit4]   2> 1768872 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=6, maxMergeAtOnceExplicit=6, maxMergedSegmentMB=93.32421875, floorSegmentMB=1.5478515625, forceMergeDeletesPctAllowed=5.098846478352163, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7081603462781312
   [junit4]   2> 1768872 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@61acd239 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@315cd7af; maxCacheMB=0.154296875 maxMergeSizeMB=0.0400390625)),segFN=segments_1,generation=1}
   [junit4]   2> 1768872 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1768873 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data/
   [junit4]   2> 1768873 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1768875 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1768875 WARN  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1768876 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1768877 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1768877 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1768878 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1768879 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 1768879 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1768880 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1768880 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1768880 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=49.322265625, floorSegmentMB=1.5009765625, forceMergeDeletesPctAllowed=28.653156873313705, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3041072926180546
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@61acd239 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@315cd7af; maxCacheMB=0.154296875 maxMergeSizeMB=0.0400390625)),segFN=segments_1,generation=1}
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@678119b4[collection1] main]
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1768881 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1768882 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1768882 INFO  (searcherExecutor-4755-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@678119b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1768883 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1768883 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1768883 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1768883 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1534634045124640768
   [junit4]   2> 1768884 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1534634045124640768
   [junit4]   2> 1768884 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1768885 INFO  (coreLoadExecutor-4754-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1768885 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:56161/_/w collection:control_collection shard:shard1
   [junit4]   2> 1768885 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1768887 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95914627731816454-core_node1-n_0000000000
   [junit4]   2> 1768887 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 1768888 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1768888 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1768888 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56161/_/w/collection1/
   [junit4]   2> 1768888 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1768888 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:56161/_/w/collection1/ has no replicas
   [junit4]   2> 1768888 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1768889 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1768890 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95914627731816454-core_node1-n_0000000000
   [junit4]   2> 1768891 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:56161/_/w/collection1/ shard1
   [junit4]   2> 1768891 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:56161/_/w",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1768992 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1769042 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:56161/_/w/collection1/ and leader is http://127.0.0.1:56161/_/w/collection1/
   [junit4]   2> 1769042 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56161/_/w
   [junit4]   2> 1769042 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1769042 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1769042 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1769043 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56161/_/w",
   [junit4]   2>   "node_name":"127.0.0.1:56161__%2Fw",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1769043 INFO  (coreZkRegister-4748-thread-1-processing-n:127.0.0.1:56161__%2Fw x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56161__%2Fw c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 1769043 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56161/_/w",
   [junit4]   2>   "node_name":"127.0.0.1:56161__%2Fw",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1769144 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1769274 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1769274 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1769275 INFO  (zkCallback-1593-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1bae1d4e name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1769275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1769275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1769275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1769276 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1769276 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1769331 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001/cores/collection1
   [junit4]   2> 1769331 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001
   [junit4]   2> 1769333 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1769334 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6b41db77{/_/w,null,AVAILABLE}
   [junit4]   2> 1769334 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1be4ecee{HTTP/1.1,[http/1.1]}{127.0.0.1:50480}
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.e.j.s.Server Started @1771926ms
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_/w, hostPort=50480, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001/cores}
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001'
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1769335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1769336 INFO  (zkCallback-1594-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40176121 name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1769336 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1769336 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1769337 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1769337 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001/solr.xml
   [junit4]   2> 1769340 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001/cores
   [junit4]   2> 1769340 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CoreContainer New CoreContainer 309222982
   [junit4]   2> 1769340 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001]
   [junit4]   2> 1769340 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001/shard-1-001/lib
   [junit4]   2> 1769340 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1769341 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1769341 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1769341 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1769342 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49105/solr
   [junit4]   2> 1769342 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1769342 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1769342 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1769342 INFO  (zkCallback-1597-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c407dd2 name:ZooKeeperConnection Watcher:127.0.0.1:49105 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1769342 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1769343 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1769343 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1769344 INFO  (zkCallback-1598-thread-1-processing-n:127.0.0.1:50480__%2Fw) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4648664a name:ZooKeeperConnection Watcher:127.0.0.1:49105/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1769344 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1769347 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1769348 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1769349 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1769349 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95914627731816458-127.0.0.1:50480__%2Fw-n_0000000001
   [junit4]   2> 1769349 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000 to know if I could be the leader
   [junit4]   2> 1769349 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.ZkController Publish node=127.0.0.1:50480__%2Fw as DOWN
   [junit4]   2> 1769350 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:50480__%2Fw"} current state version: 3
   [junit4]   2> 1769350 INFO  (OverseerStateUpdate-95914627731816454-127.0.0.1:56161__%2Fw-n_0000000000) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:50480__%2Fw
   [junit4]   2> 1769452 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1769452 INFO  (zkCallback-1598-thread-1-processing-n:127.0.0.1:50480__%2Fw) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1769452 INFO  (zkCallback-1593-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1770350 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50480__%2Fw
   [junit4]   2> 1770351 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[F255A4056D2F1DF]) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50480__%2Fw
   [junit4]   2> 1770354 INFO  (zkCallback-1593-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1770354 INFO  (zkCallback-1591-thread-1-processing-n:127.0.0.1:56161__%2Fw) [n:127.0.0.1:56161__%2Fw    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1770354 INFO  (zkCallback-1598-thread-1-processing-n:127.0.0.1:50480__%2Fw) [n:127.0.0.1:50480__%2Fw    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:S

[...truncated too long message...]

l.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41772/_/w: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	... 7 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=58898, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:56161/_/w: collection already exists: awholynewstresscollection_collection2_7
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F255A4056D2F1DF]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=58901, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41772/_/w: Could not find collection : awholynewstresscollection_collection5_7
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F255A4056D2F1DF]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
   [junit4]   2> 2567353 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[F255A4056D2F1DF]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_F255A4056D2F1DF-001
   [junit4]   2> May 18, 2016 3:24:32 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=5060, maxDocsPerChunk=636, blockSize=3), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=5060, blockSize=3)), sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=uk-UA, timezone=Pacific/Wake
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=172435992,total=480247808
   [junit4]   2> NOTE: All tests run in this JVM: [CurrencyFieldXmlFileTest, CoreAdminCreateDiscoverTest, TestSearchPerf, DistributedSuggestComponentTest, ParsingFieldUpdateProcessorsTest, TestSort, TestXIncludeConfig, PluginInfoTest, TestCustomDocTransformer, TestPHPSerializedResponseWriter, TestJmxIntegration, TestDynamicFieldCollectionResource, QueryParsingTest, TriLevelCompositeIdRoutingTest, DistributedFacetPivotLongTailTest, ShowFileRequestHandlerTest, BasicDistributedZk2Test, LukeRequestHandlerTest, TestRandomCollapseQParserPlugin, CleanupOldIndexTest, TestSchemaNameResource, TestNRTOpen, TestTolerantSearch, ConjunctionSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DistribJoinFromCollectionTest, TestSQLHandler, CoreAdminHandlerTest, SharedFSAutoReplicaFailoverTest, TestFieldSortValues, DebugComponentTest, ConnectionManagerTest, TestExpandComponent, AnalysisErrorHandlingTest, InfoHandlerTest, TestImplicitCoreProperties, LeaderInitiatedRecoveryOnCommitTest, TestZkChroot, RegexBoostProcessorTest, CircularListTest, TestStandardQParsers, DeleteStatusTest, HdfsThreadLeakTest, TestDistributedMissingSort, StatsComponentTest, FieldAnalysisRequestHandlerTest, VersionInfoTest, SSLMigrationTest, TestDocBasedVersionConstraints, BigEndianAscendingWordDeserializerTest, TestRuleBasedAuthorizationPlugin, HdfsCollectionsAPIDistributedZkTest, TestDownShardTolerantSearch, XmlUpdateRequestHandlerTest, TestUseDocValuesAsStored2, CollectionsAPISolrJTest, TestCollectionAPI, TestStressReorder, HdfsBasicDistributedZkTest, BadComponentTest, DocValuesMultiTest, BaseCdcrDistributedZkTest, TestExactStatsCache, BlockCacheTest, TestPostingsSolrHighlighter, DateRangeFieldTest, ReplicationFactorTest, TestGroupingSearch, DateMathParserTest, TestRecovery, TestStressRecovery, QueryResultKeyTest, OverseerTest, TestManagedSynonymFilterFactory, SolrCloudExampleTest, DirectUpdateHandlerTest, TestJmxMonitoredMap, TestIntervalFaceting, TestSweetSpotSimilarityFactory, HdfsDirectoryTest, JavabinLoaderTest, TestNoOpRegenerator, TestExtendedDismaxParser, DirectoryFactoryTest, TestSolrQueryResponse, SolrCoreCheckLockOnStartupTest, TestIndexSearcher, DirectUpdateHandlerOptimizeTest, TestCharFilters, TestUtils, HardAutoCommitTest, PKIAuthenticationIntegrationTest, CloneFieldUpdateProcessorFactoryTest, TestRebalanceLeaders, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [259/580 (1!)] on J2 in 800.60s, 1 test, 1 error <<< FAILURES!

[...truncated 1021 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 580 suites (10 ignored), 2318 tests, 1 error, 31 ignored (16 assumptions) [seed: F255A4056D2F1DF]

Total time: 185 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 11 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/11/

4 tests failed.
FAILED:  org.apache.solr.cloud.CloudExitableDirectoryReaderTest.test

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:48884/dj/f/collection1]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:48884/dj/f/collection1]
	at __randomizedtesting.SeedInfo.seed([7125187FF927043F:F97127A557DB69C7]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.queryServer(AbstractFullDistribZkTestBase.java:1397)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertPartialResults(CloudExitableDirectoryReaderTest.java:99)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:83)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.test(CloudExitableDirectoryReaderTest.java:50)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:48884/dj/f/collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 51 more


FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Control does not match cloud expected:<10960> but was:<3135>

Stack Trace:
java.lang.AssertionError: Control does not match cloud expected:<10960> but was:<3135>
	at __randomizedtesting.SeedInfo.seed([7125187FF927043F:F97127A557DB69C7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:678)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1463455422873,generation=2,filelist=[_ci.cfe, _ci.cfs, _ci.si, _cj.fdt, _cj.fdx, _cj.fnm, _cj.nvd, _cj.nvm, _cj.si, _cj_Asserting_0.doc, _cj_Asserting_0.tim, _cj_Asserting_0.tip, _ck.cfe, _ck.cfs, _ck.si, _cl.cfe, _cl.cfs, _cl.si, _cm.cfe, _cm.cfs, _cm.si, _cn.cfe, _cn.cfs, _cn.si, _co.cfe, _co.cfs, _co.si, _cp.cfe, _cp.cfs, _cp.si, _cq.cfe, _cq.cfs, _cq.si, _cr.cfe, _cr.cfs, _cr.si, _cs.cfe, _cs.cfs, _cs.si, _ct.cfe, _ct.cfs, _ct.si, _cu.cfe, _cu.cfs, _cu.si, _cv.cfe, _cv.cfs, _cv.si, _cw.cfe, _cw.cfs, _cw.si, _cx.cfe, _cx.cfs, _cx.si, _cz.cfe, _cz.cfs, _cz.si, _d0.cfe, _d0.cfs, _d0.si, segments_2]}]> but was:<[{indexVersion=1463455422873,generation=2,filelist=[_ci.cfe, _ci.cfs, _ci.si, _cj.fdt, _cj.fdx, _cj.fnm, _cj.nvd, _cj.nvm, _cj.si, _cj_Asserting_0.doc, _cj_Asserting_0.tim, _cj_Asserting_0.tip, _ck.cfe, _ck.cfs, _ck.si, _cl.cfe, _cl.cfs, _cl.si, _cm.cfe, _cm.cfs, _cm.si, _cn.cfe, _cn.cfs, _cn.si, _co.cfe, _co.cfs, _co.si, _cp.cfe, _cp.cfs, _cp.si, _cq.cfe, _cq.cfs, _cq.si, _cr.cfe, _cr.cfs, _cr.si, _cs.cfe, _cs.cfs, _cs.si, _ct.cfe, _ct.cfs, _ct.si, _cu.cfe, _cu.cfs, _cu.si, _cv.cfe, _cv.cfs, _cv.si, _cw.cfe, _cw.cfs, _cw.si, _cx.cfe, _cx.cfs, _cx.si, _cz.cfe, _cz.cfs, _cz.si, _d0.cfe, _d0.cfs, _d0.si, segments_2]}, {indexVersion=1463455422873,generation=3,filelist=[_cx.cfe, _cx.cfs, _cx.si, _cy.fdt, _cy.fdx, _cy.fnm, _cy.nvd, _cy.nvm, _cy.si, _cy_Asserting_0.doc, _cy_Asserting_0.tim, _cy_Asserting_0.tip, _cz.cfe, _cz.cfs, _cz.si, _d0.cfe, _d0.cfs, _d0.si, segments_3]}]>

Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1463455422873,generation=2,filelist=[_ci.cfe, _ci.cfs, _ci.si, _cj.fdt, _cj.fdx, _cj.fnm, _cj.nvd, _cj.nvm, _cj.si, _cj_Asserting_0.doc, _cj_Asserting_0.tim, _cj_Asserting_0.tip, _ck.cfe, _ck.cfs, _ck.si, _cl.cfe, _cl.cfs, _cl.si, _cm.cfe, _cm.cfs, _cm.si, _cn.cfe, _cn.cfs, _cn.si, _co.cfe, _co.cfs, _co.si, _cp.cfe, _cp.cfs, _cp.si, _cq.cfe, _cq.cfs, _cq.si, _cr.cfe, _cr.cfs, _cr.si, _cs.cfe, _cs.cfs, _cs.si, _ct.cfe, _ct.cfs, _ct.si, _cu.cfe, _cu.cfs, _cu.si, _cv.cfe, _cv.cfs, _cv.si, _cw.cfe, _cw.cfs, _cw.si, _cx.cfe, _cx.cfs, _cx.si, _cz.cfe, _cz.cfs, _cz.si, _d0.cfe, _d0.cfs, _d0.si, segments_2]}]> but was:<[{indexVersion=1463455422873,generation=2,filelist=[_ci.cfe, _ci.cfs, _ci.si, _cj.fdt, _cj.fdx, _cj.fnm, _cj.nvd, _cj.nvm, _cj.si, _cj_Asserting_0.doc, _cj_Asserting_0.tim, _cj_Asserting_0.tip, _ck.cfe, _ck.cfs, _ck.si, _cl.cfe, _cl.cfs, _cl.si, _cm.cfe, _cm.cfs, _cm.si, _cn.cfe, _cn.cfs, _cn.si, _co.cfe, _co.cfs, _co.si, _cp.cfe, _cp.cfs, _cp.si, _cq.cfe, _cq.cfs, _cq.si, _cr.cfe, _cr.cfs, _cr.si, _cs.cfe, _cs.cfs, _cs.si, _ct.cfe, _ct.cfs, _ct.si, _cu.cfe, _cu.cfs, _cu.si, _cv.cfe, _cv.cfs, _cv.si, _cw.cfe, _cw.cfs, _cw.si, _cx.cfe, _cx.cfs, _cx.si, _cz.cfe, _cz.cfs, _cz.si, _d0.cfe, _d0.cfs, _d0.si, segments_2]}, {indexVersion=1463455422873,generation=3,filelist=[_cx.cfe, _cx.cfs, _cx.si, _cy.fdt, _cy.fdx, _cy.fnm, _cy.nvd, _cy.nvm, _cy.si, _cy_Asserting_0.doc, _cy_Asserting_0.tim, _cy_Asserting_0.tip, _cz.cfe, _cz.cfs, _cz.si, _d0.cfe, _d0.cfs, _d0.si, segments_3]}]>
	at __randomizedtesting.SeedInfo.seed([7125187FF927043F:54F2034F896F0A3C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1143)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:58237

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:58237
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:382)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:498)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 47 more




Build Log:
[...truncated 11032 lines...]
   [junit4] Suite: org.apache.solr.cloud.CloudExitableDirectoryReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/init-core-data-001
   [junit4]   2> 31923 INFO  (SUITE-CloudExitableDirectoryReaderTest-seed#[7125187FF927043F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 31923 INFO  (SUITE-CloudExitableDirectoryReaderTest-seed#[7125187FF927043F]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /dj/f
   [junit4]   2> 31939 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 31952 INFO  (Thread-64) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 31952 INFO  (Thread-64) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 32042 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.ZkTestServer start zk server on port:37591
   [junit4]   2> 32044 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 32070 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 32086 INFO  (zkCallback-23-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@340633f3 name:ZooKeeperConnection Watcher:127.0.0.1:37591 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 32086 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 32087 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 32087 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 32093 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 32110 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 32122 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46adb3b name:ZooKeeperConnection Watcher:127.0.0.1:37591/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 32122 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 32123 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 32123 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 32128 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 32129 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 32131 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 32134 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog-with-delayingcomponent.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 32134 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 32143 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 32143 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 32146 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 32146 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 32148 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 32149 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 32153 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 32153 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 32156 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 32156 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 32158 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 32158 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 32160 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 32160 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 32163 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 32163 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 32164 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 32164 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 32167 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 32167 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 32248 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1
   [junit4]   2> 32249 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 32252 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@182adaf2{/dj/f,null,AVAILABLE}
   [junit4]   2> 32253 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@5ad8de30{HTTP/1.1,[http/1.1]}{127.0.0.1:60054}
   [junit4]   2> 32253 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.e.j.s.Server Started @34320ms
   [junit4]   2> 32253 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/tempDir-001/control/data, hostContext=/dj/f, hostPort=60054, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores}
   [junit4]   2> 32253 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 32254 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001'
   [junit4]   2> 32254 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 32254 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 32254 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 32259 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 32262 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@28b2e93f name:ZooKeeperConnection Watcher:127.0.0.1:37591/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 32262 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 32263 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 32264 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x154bc9e95550002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 32268 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 32268 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/solr.xml
   [junit4]   2> 32273 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores
   [junit4]   2> 32273 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.CoreContainer New CoreContainer 1392145232
   [junit4]   2> 32273 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001]
   [junit4]   2> 32273 WARN  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/lib
   [junit4]   2> 32273 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 32274 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 32274 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 32274 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 32275 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37591/solr
   [junit4]   2> 32285 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 32286 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 32286 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 32292 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a786f45 name:ZooKeeperConnection Watcher:127.0.0.1:37591 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 32293 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 32293 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 32302 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 32304 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7df27b07 name:ZooKeeperConnection Watcher:127.0.0.1:37591/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 32305 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 32309 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 32314 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 32319 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 32323 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 32325 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 32332 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 32333 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 32338 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 32342 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 32343 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 32348 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 32355 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 32363 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 32365 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 32367 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000
   [junit4]   2> 32368 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60054_dj%2Ff
   [junit4]   2> 32368 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 32369 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer Overseer (id=95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) starting
   [junit4]   2> 32374 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 32394 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 32397 INFO  (OverseerCollectionConfigSetProcessor-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 32398 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60054_dj%2Ff
   [junit4]   2> 32399 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60054_dj%2Ff
   [junit4]   2> 32399 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 32403 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 32408 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 32460 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 32460 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 32461 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores
   [junit4]   2> 32463 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 32463 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1
   [junit4]   2> 32463 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 32466 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 32466 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 32466 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 32466 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 32469 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60054/dj/f",
   [junit4]   2>   "node_name":"127.0.0.1:60054_dj%2Ff",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 32472 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 32476 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60054/dj/f",
   [junit4]   2>   "node_name":"127.0.0.1:60054_dj%2Ff",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 32477 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 32484 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 32493 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 33473 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 33473 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 33473 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 33473 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 33474 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 33474 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1'
   [junit4]   2> 33474 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 33475 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 33476 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 33493 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 33504 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 33555 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 33563 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 33893 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 33944 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 33945 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 34242 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 34243 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 34245 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 34246 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 34247 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0
   [junit4]   2> 34247 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 34247 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 34247 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data/]
   [junit4]   2> 34247 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@56a81a76
   [junit4]   2> 34248 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data
   [junit4]   2> 34248 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data/index/
   [junit4]   2> 34248 WARN  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 34248 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data/index
   [junit4]   2> 34248 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=48.0634765625, floorSegmentMB=1.1064453125, forceMergeDeletesPctAllowed=14.624760693385587, segmentsPerTier=2.0, maxCFSSegmentSizeMB=0.4140625, noCFSRatio=0.0
   [junit4]   2> 34249 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@470c0795 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29391de9),segFN=segments_1,generation=1}
   [junit4]   2> 34249 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 34249 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data/
   [junit4]   2> 34249 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 34252 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 34252 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 34252 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 34252 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 34252 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 34252 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 34253 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 34253 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 34253 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 34254 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 34257 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 34257 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 34258 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 34260 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 34260 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 34275 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 34275 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 34276 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 34276 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 34286 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6121199041542551]
   [junit4]   2> 34287 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@470c0795 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@29391de9),segFN=segments_1,generation=1}
   [junit4]   2> 34287 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 34287 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6600a8e4[collection1] main]
   [junit4]   2> 34287 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 34288 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 34288 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 34291 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 34291 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 34291 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 34292 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 34293 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 34293 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 34293 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 34293 INFO  (searcherExecutor-121-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6600a8e4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 34294 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 34294 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 34295 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 34295 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1534542104485691392
   [junit4]   2> 34296 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1534542104485691392
   [junit4]   2> 34297 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 34307 INFO  (coreLoadExecutor-120-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 34325 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:60054/dj/f collection:control_collection shard:shard1
   [junit4]   2> 34335 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 34364 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95908881377853444-core_node1-n_0000000000
   [junit4]   2> 34365 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 34369 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 34369 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 34370 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60054/dj/f/collection1/
   [junit4]   2> 34370 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 34373 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 34373 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:60054/dj/f/collection1/ has no replicas
   [junit4]   2> 34373 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 34432 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 34448 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95908881377853444-core_node1-n_0000000000
   [junit4]   2> 34473 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:60054/dj/f",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 34474 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60054/dj/f/collection1/ shard1
   [junit4]   2> 34648 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 34654 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 34678 INFO  (zkCallback-31-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@453dff12 name:ZooKeeperConnection Watcher:127.0.0.1:37591/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 34678 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 34679 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 34679 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 34681 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 34683 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 34683 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 34683 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 34698 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 34726 INFO  (zkCallback-32-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63584ed7 name:ZooKeeperConnection Watcher:127.0.0.1:37591/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 34726 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 34727 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 34739 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 34739 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 34739 INFO  (zkCallback-31-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 34739 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 34760 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:60054/dj/f/collection1/ and leader is http://127.0.0.1:60054/dj/f/collection1/
   [junit4]   2> 34760 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60054/dj/f
   [junit4]   2> 34760 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 34760 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 34760 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 34762 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60054/dj/f",
   [junit4]   2>   "node_name":"127.0.0.1:60054_dj%2Ff",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 34762 INFO  (coreZkRegister-114-thread-1-processing-n:127.0.0.1:60054_dj%2Ff x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:60054_dj%2Ff c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 34763 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:60054/dj/f",
   [junit4]   2>   "node_name":"127.0.0.1:60054_dj%2Ff",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 34763 INFO  (OverseerStateUpdate-95908881377853444-127.0.0.1:60054_dj%2Ff-n_0000000000) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 34867 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/shard-1-001/cores/collection1
   [junit4]   2> 34868 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest_7125187FF927043F-001/shard-1-001
   [junit4]   2> 34870 INFO  (TEST-CloudExitableDirectoryReaderTest.test-seed#[7125187FF927043F]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 34872 INFO  (zkCallback-29-thread-1-processing-n:127.0.0.1:60054_dj%2Ff) [n:127.0.0.1:60054_dj%2Ff    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 34872 INFO  (zkCallback-31-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], ha

[...truncated too long message...]

SolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=37107, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38747: collection already exists: awholynewstresscollection_collection1_5
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7125187FF927043F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=37111, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38747: collection already exists: awholynewstresscollection_collection5_5
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7125187FF927043F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)
   [junit4]   2> 2254607 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[7125187FF927043F]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7125187FF927043F-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=Lucene50(blocksize=128), multiDefault=FSTOrd50, a_t=FSTOrd50, intDefault=Lucene50(blocksize=128), a_i1=FSTOrd50, id=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_i_dv=FSTOrd50, text=PostingsFormat(name=Asserting), range_facet_l=FSTOrd50, timestamp=FSTOrd50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=747, maxMBSortInHeap=6.000660642182362, sim=ClassicSimilarity, locale=es-DO, timezone=Europe/Bratislava
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=139438344,total=515899392
   [junit4]   2> NOTE: All tests run in this JVM: [MigrateRouteKeyTest, HdfsSyncSliceTest, TestSolrDeletionPolicy2, TermVectorComponentTest, TestSolrConfigHandlerConcurrent, ResponseHeaderTest, BJQParserTest, SchemaVersionSpecificBehaviorTest, DistributedIntervalFacetingTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, SolrIndexSplitterTest, TestCursorMarkWithoutUniqueKey, DirectSolrSpellCheckerTest, MultiTermTest, FileUtilsTest, TestCodecSupport, HdfsUnloadDistributedZkTest, TestLeaderElectionZkExpiry, SolrCmdDistributorTest, TestEmbeddedSolrServerConstructors, HdfsChaosMonkeySafeLeaderTest, DistributedVersionInfoTest, MoreLikeThisHandlerTest, TestSizeLimitedDistributedMap, TestSystemIdResolver, CollectionsAPIAsyncDistributedZkTest, SimpleCollectionCreateDeleteTest, TestFieldTypeResource, NumericFieldsTest, TestSchemaSimilarityResource, TestObjectReleaseTracker, DocumentBuilderTest, BlockJoinFacetSimpleTest, TestHashPartitioner, TestDistributedStatsComponentCardinality, TestBlendedInfixSuggestions, TestInitParams, TestMinMaxOnMultiValuedField, TestDFRSimilarityFactory, SolrInfoMBeanTest, TestCustomSort, TestCloudPivotFacet, TestExactSharedStatsCache, AddBlockUpdateTest, TestHighFrequencyDictionaryFactory, SpellingQueryConverterTest, DistributedTermsComponentTest, AliasIntegrationTest, TestReRankQParserPlugin, SpellPossibilityIteratorTest, ZkCLITest, MBeansHandlerTest, TestClusterStateMutator, TestSolrQueryParserDefaultOperatorResource, TestPKIAuthenticationPlugin, CdcrReplicationHandlerTest, TestCoreContainer, TestQuerySenderNoQuery, ZkSolrClientTest, SuggesterFSTTest, TestSearcherReuse, TestDynamicLoading, TestNonDefinedSimilarityFactory, BasicAuthIntegrationTest, TestNamedUpdateProcessors, TestLMJelinekMercerSimilarityFactory, TestShardHandlerFactory, TestConfigSetImmutable, TestSolrCoreProperties, HdfsBasicDistributedZk2Test, SmileWriterTest, TestScoreJoinQPScore, TestRawTransformer, DistributedFacetPivotLargeTest, TestDistribDocBasedVersion, SegmentsInfoRequestHandlerTest, SolrIndexConfigTest, NotRequiredUniqueKeyTest, TestDistributedGrouping, AtomicUpdatesTest, DistributedMLTComponentTest, TestChildDocTransformer, ConfigSetsAPITest, TestSimpleTrackingShardHandler, TestManagedResource, OverseerStatusTest, DOMUtilTest, OverriddenZkACLAndCredentialsProvidersTest, TimeZoneUtilsTest, HLLSerializationTest, CachingDirectoryFactoryTest, FastVectorHighlighterTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [259/580 (4!)] on J1 in 625.90s, 1 test, 1 error <<< FAILURES!

[...truncated 1031 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 580 suites (10 ignored), 2318 tests, 2 errors, 2 failures, 31 ignored (16 assumptions) [seed: 7125187FF927043F]

Total time: 190 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 10 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/10/

2 tests failed.
FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([EE783DC3BFE4A44F:662C02191118C9B7]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:226)
	at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:107)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=58910, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=58910, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50839: collection already exists: awholynewstresscollection_collection3_0
	at __randomizedtesting.SeedInfo.seed([EE783DC3BFE4A44F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)




Build Log:
[...truncated 11253 lines...]
   [junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/init-core-data-001
   [junit4]   2> 756182 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 756321 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 756358 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 756359 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 756387 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_40829_hdfs____shvgod/webapp
   [junit4]   2> 756754 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 757295 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40829
   [junit4]   2> 757611 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 757611 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 757629 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_56558_datanode____swbrge/webapp
   [junit4]   2> 757837 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 758207 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56558
   [junit4]   2> 758350 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 758351 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 758363 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_60985_datanode____.ly8l5p/webapp
   [junit4]   2> 758529 INFO  (IPC Server handler 2 on 49343) [    ] BlockStateChange BLOCK* processReport: from storage DS-120f5b51-2c97-4598-a9ce-5ec4ac82ad9c node DatanodeRegistration(127.0.0.1, datanodeUuid=37488f8e-66ab-4f3e-8499-adeeebb7b060, infoPort=56558, ipcPort=35975, storageInfo=lv=-56;cid=testClusterID;nsid=774590996;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 758529 INFO  (IPC Server handler 2 on 49343) [    ] BlockStateChange BLOCK* processReport: from storage DS-10a7b61d-06d4-4644-ab59-25dec32dc1e0 node DatanodeRegistration(127.0.0.1, datanodeUuid=37488f8e-66ab-4f3e-8499-adeeebb7b060, infoPort=56558, ipcPort=35975, storageInfo=lv=-56;cid=testClusterID;nsid=774590996;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 758545 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 758850 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60985
   [junit4]   2> 759253 INFO  (IPC Server handler 9 on 49343) [    ] BlockStateChange BLOCK* processReport: from storage DS-9e7b6205-e0ef-4505-b9b9-6f0f2d2dea07 node DatanodeRegistration(127.0.0.1, datanodeUuid=82241f86-e28c-4833-97bd-2311b1de7442, infoPort=60985, ipcPort=38300, storageInfo=lv=-56;cid=testClusterID;nsid=774590996;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 759254 INFO  (IPC Server handler 9 on 49343) [    ] BlockStateChange BLOCK* processReport: from storage DS-0537eabc-3bd5-4319-a315-be7867ab6571 node DatanodeRegistration(127.0.0.1, datanodeUuid=82241f86-e28c-4833-97bd-2311b1de7442, infoPort=60985, ipcPort=38300, storageInfo=lv=-56;cid=testClusterID;nsid=774590996;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 759579 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 759583 INFO  (Thread-9219) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 759583 INFO  (Thread-9219) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 759683 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ZkTestServer start zk server on port:53519
   [junit4]   2> 759683 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 759697 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 759710 INFO  (zkCallback-705-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15914b9e name:ZooKeeperConnection Watcher:127.0.0.1:53519 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 759710 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 759710 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 759710 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 759712 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 759713 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 759715 INFO  (zkCallback-706-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@812867e name:ZooKeeperConnection Watcher:127.0.0.1:53519/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 759715 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 759715 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 759715 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 759722 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 759722 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 759723 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 759744 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 759744 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 759815 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 759815 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 759816 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 759816 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 759817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 759817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 759824 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 759824 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 759826 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 759826 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 759828 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 759828 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 759830 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 759830 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 759830 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 759831 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 759831 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 759831 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 759832 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 759832 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 759989 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores/collection1
   [junit4]   2> 759990 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2488ed25{/,null,AVAILABLE}
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@22eb05ce{HTTP/1.1,[http/1.1]}{127.0.0.1:55233}
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.Server Started @762266ms
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=55233, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores}
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001'
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 760051 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 760053 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 760073 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 760074 INFO  (zkCallback-707-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@21548353 name:ZooKeeperConnection Watcher:127.0.0.1:53519/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 760074 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 760074 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 760085 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 760085 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/solr.xml
   [junit4]   2> 760089 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores
   [junit4]   2> 760089 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CoreContainer New CoreContainer 970687894
   [junit4]   2> 760089 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001]
   [junit4]   2> 760089 WARN  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/lib
   [junit4]   2> 760089 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 760090 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 760090 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 760091 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 760091 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53519/solr
   [junit4]   2> 760091 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 760091 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 760091 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 760105 INFO  (zkCallback-710-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7a9012e8 name:ZooKeeperConnection Watcher:127.0.0.1:53519 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 760107 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 760108 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 760125 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 760133 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@26c554c7 name:ZooKeeperConnection Watcher:127.0.0.1:53519/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 760133 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 760137 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 760142 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 760155 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 760156 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 760156 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 760157 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 760157 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 760158 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 760158 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 760158 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 760159 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 760160 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 760162 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 760165 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 760165 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95905316050173956-127.0.0.1:55233_-n_0000000000
   [junit4]   2> 760166 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55233_
   [junit4]   2> 760166 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 760167 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer Overseer (id=95905316050173956-127.0.0.1:55233_-n_0000000000) starting
   [junit4]   2> 760169 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 760176 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 760177 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 760177 INFO  (OverseerCollectionConfigSetProcessor-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 760181 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55233_
   [junit4]   2> 760182 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:55233_
   [junit4]   2> 760182 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 760184 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 760185 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 760193 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 760193 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 760193 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores
   [junit4]   2> 760194 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 760194 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores/collection1
   [junit4]   2> 760194 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 760195 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 760195 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:55233_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 760196 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 760196 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 760198 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 760199 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:55233",
   [junit4]   2>   "node_name":"127.0.0.1:55233_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 760200 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:55233",
   [junit4]   2>   "node_name":"127.0.0.1:55233_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 760200 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 760201 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 760203 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 761198 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 761199 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 761199 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 761199 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 761199 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 761199 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores/collection1'
   [junit4]   2> 761200 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 761200 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 761201 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 761205 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 761208 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.1
   [junit4]   2> 761217 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 761222 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 761314 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 761318 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 761319 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 761326 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 761328 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 761330 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 761331 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 761333 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 761333 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 761333 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 761333 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:49343/solr_hdfs_home
   [junit4]   2> 761333 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 761334 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/control-001/cores/collection1], dataDir=[hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 761334 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2b2361cc
   [junit4]   2> 761334 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 761344 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 761345 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 761351 WARN  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:49343/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 761351 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 761356 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 761356 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 761359 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 761359 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 761360 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=30, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 761376 INFO  (IPC Server handler 6 on 49343) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:59225 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-10a7b61d-06d4-4644-ab59-25dec32dc1e0:NORMAL:127.0.0.1:53869|RBW], ReplicaUnderConstruction[[DISK]DS-0537eabc-3bd5-4319-a315-be7867ab6571:NORMAL:127.0.0.1:59225|RBW]]} size 0
   [junit4]   2> 761377 INFO  (IPC Server handler 7 on 49343) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:53869 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-0537eabc-3bd5-4319-a315-be7867ab6571:NORMAL:127.0.0.1:59225|RBW], ReplicaUnderConstruction[[DISK]DS-120f5b51-2c97-4598-a9ce-5ec4ac82ad9c:NORMAL:127.0.0.1:53869|FINALIZED]]} size 0
   [junit4]   2> 761380 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38666797); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 761380 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 761381 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 761385 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 761385 WARN  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 761386 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 761387 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 761389 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 761389 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 761395 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 761395 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 761395 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 761395 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 761401 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 761401 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 761402 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4041897098755882]
   [junit4]   2> 761407 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:49343/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38666797); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 761407 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 761407 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5ea0b7d2[collection1] main]
   [junit4]   2> 761408 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 761408 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 761408 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 761408 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 761408 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 761408 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 761409 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 761409 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 761409 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 761409 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 761410 INFO  (searcherExecutor-3835-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5ea0b7d2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1534485058713288704
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1534485058713288704
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 761410 INFO  (coreLoadExecutor-3834-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 761411 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:55233 collection:control_collection shard:shard1
   [junit4]   2> 761411 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 761413 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95905316050173956-core_node1-n_0000000000
   [junit4]   2> 761414 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 761415 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 761415 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 761415 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55233/collection1/
   [junit4]   2> 761415 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 761415 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:55233/collection1/ has no replicas
   [junit4]   2> 761415 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 761416 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 761417 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95905316050173956-core_node1-n_0000000000
   [junit4]   2> 761419 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55233/collection1/ shard1
   [junit4]   2> 761423 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:55233",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 761525 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 761528 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:55233/collection1/ and leader is http://127.0.0.1:55233/collection1/
   [junit4]   2> 761532 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55233
   [junit4]   2> 761532 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 761532 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 761532 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 761533 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:55233",
   [junit4]   2>   "node_name":"127.0.0.1:55233_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 761533 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:55233",
   [junit4]   2>   "node_name":"127.0.0.1:55233_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 761536 INFO  (coreZkRegister-3828-thread-1-processing-n:127.0.0.1:55233_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:55233_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 761636 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 761697 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 761701 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 761702 INFO  (zkCallback-713-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@276f854f name:ZooKeeperConnection Watcher:127.0.0.1:53519/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 761702 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 761702 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 761702 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 761703 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 761703 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 761846 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/cores/collection1
   [junit4]   2> 761847 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001
   [junit4]   2> 761853 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 761901 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ac98a13{/,null,AVAILABLE}
   [junit4]   2> 761901 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@325685eb{HTTP/1.1,[http/1.1]}{127.0.0.1:54070}
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.e.j.s.Server Started @764116ms
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, hostContext=/, hostPort=54070, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/cores}
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001'
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 761902 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 761908 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 763724 INFO  (zkCallback-714-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c8357b6 name:ZooKeeperConnection Watcher:127.0.0.1:53519/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 763724 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 763727 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 763728 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 763728 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/solr.xml
   [junit4]   2> 763736 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/cores
   [junit4]   2> 763736 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CoreContainer New CoreContainer 1139099356
   [junit4]   2> 763736 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001]
   [junit4]   2> 763736 WARN  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/lib
   [junit4]   2> 763744 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 763745 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 763745 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 763745 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 763745 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53519/solr
   [junit4]   2> 763745 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 763745 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 763753 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 763769 INFO  (zkCallback-717-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@125f1bea name:ZooKeeperConnection Watcher:127.0.0.1:53519 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 763770 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 763771 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 763784 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 763786 INFO  (zkCallback-718-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@60316151 name:ZooKeeperConnection Watcher:127.0.0.1:53519/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 763786 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 763804 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 763805 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 763806 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 763806 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95905316050173960-127.0.0.1:54070_-n_0000000001
   [junit4]   2> 763807 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95905316050173956-127.0.0.1:55233_-n_0000000000 to know if I could be the leader
   [junit4]   2> 763807 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.ZkController Publish node=127.0.0.1:54070_ as DOWN
   [junit4]   2> 763808 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:54070_"} current state version: 3
   [junit4]   2> 763808 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:54070_
   [junit4]   2> 763809 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 763809 INFO  (zkCallback-713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 763809 INFO  (zkCallback-718-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 764808 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54070_
   [junit4]   2> 764809 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54070_
   [junit4]   2> 764809 INFO  (zkCallback-713-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 764809 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 764810 INFO  (zkCallback-713-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 764810 INFO  (zkCallback-718-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 764810 INFO  (zkCallback-711-thread-1-processing-n:127.0.0.1:55233_) [n:127.0.0.1:55233_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 764810 INFO  (zkCallback-718-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 764817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 764817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 764817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/cores
   [junit4]   2> 764818 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 764818 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_EE783DC3BFE4A44F-001/shard-1-001/cores/collection1
   [junit4]   2> 764818 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 764819 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 764819 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[EE783DC3BFE4A44F]) [n:127.0.0.1:54070_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 764819 INFO  (coreLoadExecutor-3845-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 764819 INFO  (coreLoadExecutor-3845-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 764821 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54070",
   [junit4]   2>   "node_name":"127.0.0.1:54070_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 764821 INFO  (coreLoadExecutor-3845-thread-1-processing-n:127.0.0.1:54070_) [n:127.0.0.1:54070_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 764821 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54070",
   [junit4]   2>   "node_name":"127.0.0.1:54070_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 764821 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 764821 INFO  (OverseerStateUpdate-95905316050173956-127.0.0.1:55233_-n_0000000000) [n:127.0.0.1:55233_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 764923 INFO  (zkCallback-713-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:Sync

[...truncated too long message...]

in thread: Thread[id=58909, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50839: collection already exists: awholynewstresscollection_collection2_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EE783DC3BFE4A44F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=58911, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50839: collection already exists: awholynewstresscollection_collection4_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EE783DC3BFE4A44F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=58907, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50839: collection already exists: awholynewstresscollection_collection0_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EE783DC3BFE4A44F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)
   [junit4]   2> 2342168 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[EE783DC3BFE4A44F]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> May 16, 2016 12:09:30 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene60, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=es-PA, timezone=VST
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=105581488,total=498073600
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollationField, TestSolrQueryParser, TestSearchPerf, HdfsDirectoryTest, CheckHdfsIndexTest, RequestLoggingTest, TestImplicitCoreProperties, FullSolrCloudDistribCmdsTest, HdfsCollectionsAPIDistributedZkTest, SuggestComponentContextFilterQueryTest, CoreAdminHandlerTest, ZkStateReaderTest, TestIndexSearcher, TestStressReorder, TestSimpleQParserPlugin, TestConfigSetsAPIZkFailure, BadComponentTest, TestSweetSpotSimilarityFactory, TestStressRecovery, DirectUpdateHandlerOptimizeTest, TestManagedResourceStorage, TestElisionMultitermQuery, NoCacheHeaderTest, TestDynamicFieldCollectionResource, TestCoreDiscovery, StatsComponentTest, BigEndianAscendingWordDeserializerTest, AutoCommitTest, TestOrdValues, CircularListTest, TestSolrCloudWithKerberosAlt, SuggesterTest, TestIndexingPerformance, TestXmlQParser, TestFastWriter, ExplicitHLLTest, TestRequestStatusCollectionAPI, TestReversedWildcardFilterFactory, ParsingFieldUpdateProcessorsTest, CloneFieldUpdateProcessorFactoryTest, StatelessScriptUpdateProcessorFactoryTest, TestRecoveryHdfs, CoreAdminCreateDiscoverTest, TestSolrConfigHandler, TestRecovery, TestPHPSerializedResponseWriter, CurrencyFieldXmlFileTest, SharedFSAutoReplicaFailoverTest, XmlUpdateRequestHandlerTest, TestUseDocValuesAsStored2, TestJmxIntegration, PrimitiveFieldTypeTest, TestManagedSchema, VersionInfoTest, DirectUpdateHandlerTest, TestStandardQParsers, TestReload, TestJmxMonitoredMap, TestJsonRequest, DistribJoinFromCollectionTest, LeaderInitiatedRecoveryOnCommitTest, SolrCoreCheckLockOnStartupTest, TestExactStatsCache, BlockJoinFacetDistribTest, MultiThreadedOCPTest, ConjunctionSolrSpellCheckerTest, TestSQLHandler, InfoHandlerTest, TestExtendedDismaxParser, TestFileDictionaryLookup, ConnectionManagerTest, TestExpandComponent, TestJettySolrRunner, SuggesterWFSTTest, DirectoryFactoryTest, SearchHandlerTest, TestXIncludeConfig, SSLMigrationTest, TestCloudDeleteByQuery, RecoveryZkTest, TestSchemaVersionResource, DistributedSuggestComponentTest, SampleTest, HardAutoCommitTest, JavabinLoaderTest, HdfsWriteToMultipleCollectionsTest, BadIndexSchemaTest, SpatialRPTFieldTypeTest, BlockCacheTest, BasicDistributedZk2Test, HdfsBasicDistributedZkTest, TestCSVResponseWriter, CleanupOldIndexTest, TestPerFieldSimilarityClassic, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [268/580 (2!)] on J2 in 443.89s, 1 test, 1 error <<< FAILURES!

[...truncated 1000 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 580 suites (10 ignored), 2318 tests, 1 error, 1 failure, 31 ignored (16 assumptions) [seed: EE783DC3BFE4A44F]

Total time: 183 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 9 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/9/

2 tests failed.
FAILED:  org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([B6CCE611E92FAA00:3E98D9CB47D3C7F8]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.testBasics(SharedFSAutoReplicaFailoverTest.java:226)
	at org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest.test(SharedFSAutoReplicaFailoverTest.java:107)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=22778, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22778, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42547/sdn: collection already exists: awholynewstresscollection_collection5_0
	at __randomizedtesting.SeedInfo.seed([B6CCE611E92FAA00]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)




Build Log:
[...truncated 11619 lines...]
   [junit4] Suite: org.apache.solr.cloud.SharedFSAutoReplicaFailoverTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/init-core-data-001
   [junit4]   2> 1996853 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1997272 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1997292 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1997302 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1997366 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_59029_hdfs____.3ipybn/webapp
   [junit4]   2> 1997519 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2000059 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59029
   [junit4]   2> 2000390 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2000391 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 2000406 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_49475_datanode____p4c91w/webapp
   [junit4]   2> 2000848 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2001774 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49475
   [junit4]   2> 2002578 WARN  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 2002579 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 2002625 INFO  (IPC Server handler 8 on 41454) [    ] BlockStateChange BLOCK* processReport: from storage DS-b1caf4c0-2175-426c-99dd-6fdc77fa6290 node DatanodeRegistration(127.0.0.1, datanodeUuid=10d2b034-5801-46ab-a944-d5a19f7c0eca, infoPort=49475, ipcPort=43803, storageInfo=lv=-56;cid=testClusterID;nsid=1914638909;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 2002625 INFO  (IPC Server handler 8 on 41454) [    ] BlockStateChange BLOCK* processReport: from storage DS-a6329837-b175-4bed-8499-e7b3e3916168 node DatanodeRegistration(127.0.0.1, datanodeUuid=10d2b034-5801-46ab-a944-d5a19f7c0eca, infoPort=49475, ipcPort=43803, storageInfo=lv=-56;cid=testClusterID;nsid=1914638909;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2002633 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_46754_datanode____4rcapn/webapp
   [junit4]   2> 2003282 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 2004227 INFO  (SUITE-SharedFSAutoReplicaFailoverTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46754
   [junit4]   2> 2004987 INFO  (IPC Server handler 7 on 41454) [    ] BlockStateChange BLOCK* processReport: from storage DS-bf8fe80b-9caf-4454-9ab5-d6d27d9627c2 node DatanodeRegistration(127.0.0.1, datanodeUuid=e20ea8a0-c20e-4bc4-9560-cf0e0ac5b8cf, infoPort=46754, ipcPort=33610, storageInfo=lv=-56;cid=testClusterID;nsid=1914638909;c=0), blocks: 0, hasStaleStorages: true, processing time: 346 msecs
   [junit4]   2> 2005105 INFO  (IPC Server handler 7 on 41454) [    ] BlockStateChange BLOCK* processReport: from storage DS-98c3388f-8f54-4ee6-a653-9108fb8d5baf node DatanodeRegistration(127.0.0.1, datanodeUuid=e20ea8a0-c20e-4bc4-9560-cf0e0ac5b8cf, infoPort=46754, ipcPort=33610, storageInfo=lv=-56;cid=testClusterID;nsid=1914638909;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2005166 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2005172 INFO  (Thread-14398) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2005172 INFO  (Thread-14398) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2005293 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ZkTestServer start zk server on port:56495
   [junit4]   2> 2005293 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2005297 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2005370 INFO  (zkCallback-1122-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ee0208b name:ZooKeeperConnection Watcher:127.0.0.1:56495 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2005370 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2005370 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2005370 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2005412 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2005417 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2005509 INFO  (zkCallback-1123-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c7df997 name:ZooKeeperConnection Watcher:127.0.0.1:56495/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2005509 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2005509 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2005509 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 2005510 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 2005510 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 2005511 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 2005512 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2005512 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2005521 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2005521 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 2005522 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2005522 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2005673 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2005673 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2005685 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2005685 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2005686 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2005686 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 2005686 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2005686 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2005687 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2005687 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2005694 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2005694 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2005812 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2005812 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2005817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2005817 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2006185 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores/collection1
   [junit4]   2> 2006187 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 2006197 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d60d8d9{/,null,AVAILABLE}
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1c59bdd8{HTTP/1.1,[http/1.1]}{127.0.0.1:43625}
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.Server Started @2012345ms
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=43625, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores}
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001'
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2006198 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2006199 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2006289 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2006320 INFO  (zkCallback-1124-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@728efe2c name:ZooKeeperConnection Watcher:127.0.0.1:56495/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2006320 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2006321 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2006322 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2006322 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/solr.xml
   [junit4]   2> 2006327 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores
   [junit4]   2> 2006327 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CoreContainer New CoreContainer 1155440235
   [junit4]   2> 2006327 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001]
   [junit4]   2> 2006327 WARN  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/lib
   [junit4]   2> 2006328 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2006329 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 2006330 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2006330 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2006330 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56495/solr
   [junit4]   2> 2006330 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 2006330 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2006332 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2006336 INFO  (zkCallback-1127-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@61ddc491 name:ZooKeeperConnection Watcher:127.0.0.1:56495 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2006353 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2006353 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2006354 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2006355 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@788b9999 name:ZooKeeperConnection Watcher:127.0.0.1:56495/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2006355 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2006355 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2006356 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 2006357 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 2006358 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 2006365 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 2006386 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2006405 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2006406 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2006406 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2006413 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2006413 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2006421 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2006422 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 2006433 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2006433 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95696417144242180-127.0.0.1:43625_-n_0000000000
   [junit4]   2> 2006433 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43625_
   [junit4]   2> 2006433 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 2006434 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer Overseer (id=95696417144242180-127.0.0.1:43625_-n_0000000000) starting
   [junit4]   2> 2006441 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 2006494 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2006495 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2006495 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2006496 INFO  (OverseerCollectionConfigSetProcessor-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 2006553 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43625_
   [junit4]   2> 2006553 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43625_
   [junit4]   2> 2006554 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2006554 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2006588 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 2006588 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 2006601 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores
   [junit4]   2> 2006602 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 2006602 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores/collection1
   [junit4]   2> 2006602 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 2006645 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 2006645 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:43625_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 2006693 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 2006693 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 2006772 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 2006772 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43625",
   [junit4]   2>   "node_name":"127.0.0.1:43625_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2006773 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43625",
   [junit4]   2>   "node_name":"127.0.0.1:43625_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2006773 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 2006773 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 2006774 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2007772 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2007772 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 2007773 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 2007773 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 2007773 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 2007773 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores/collection1'
   [junit4]   2> 2007773 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2007773 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2007775 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 2007779 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 2007782 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 2007789 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2007794 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2008063 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2008068 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 2008070 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 2008080 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 2008085 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 2008086 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2008087 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2008087 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:41454/solr_hdfs_home
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/control-001/cores/collection1], dataDir=[hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b953fd9
   [junit4]   2> 2008088 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 2008103 WARN  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 2010583 INFO  (IPC Server handler 7 on 41454) [    ] BlockStateChange BLOCK* processReport: from storage DS-bf8fe80b-9caf-4454-9ab5-d6d27d9627c2 node DatanodeRegistration(127.0.0.1, datanodeUuid=e20ea8a0-c20e-4bc4-9560-cf0e0ac5b8cf, infoPort=46754, ipcPort=33610, storageInfo=lv=-56;cid=testClusterID;nsid=1914638909;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2010583 INFO  (IPC Server handler 7 on 41454) [    ] BlockStateChange BLOCK* processReport: from storage DS-98c3388f-8f54-4ee6-a653-9108fb8d5baf node DatanodeRegistration(127.0.0.1, datanodeUuid=e20ea8a0-c20e-4bc4-9560-cf0e0ac5b8cf, infoPort=46754, ipcPort=33610, storageInfo=lv=-56;cid=testClusterID;nsid=1914638909;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 2013361 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 2013374 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 2013436 WARN  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:41454/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 2013436 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 2013442 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 2013442 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 2013442 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 2013452 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 2013452 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 2013453 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=0.3779296875, floorSegmentMB=0.845703125, forceMergeDeletesPctAllowed=15.406678918116604, segmentsPerTier=28.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8836452750107364
   [junit4]   2> 2013828 INFO  (IPC Server handler 8 on 41454) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49090 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-a6329837-b175-4bed-8499-e7b3e3916168:NORMAL:127.0.0.1:49543|RBW], ReplicaUnderConstruction[[DISK]DS-bf8fe80b-9caf-4454-9ab5-d6d27d9627c2:NORMAL:127.0.0.1:49090|RBW]]} size 0
   [junit4]   2> 2013830 INFO  (IPC Server handler 9 on 41454) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49543 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-bf8fe80b-9caf-4454-9ab5-d6d27d9627c2:NORMAL:127.0.0.1:49090|RBW], ReplicaUnderConstruction[[DISK]DS-b1caf4c0-2175-426c-99dd-6fdc77fa6290:NORMAL:127.0.0.1:49543|FINALIZED]]} size 0
   [junit4]   2> 2013844 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c770f7d); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 2013844 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 2013849 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 2013851 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2013851 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2013851 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2013851 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2013851 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2013852 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2013852 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2013852 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2013852 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2013852 WARN  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 2013853 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2013854 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2013854 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2013855 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2013859 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 2013859 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 2013859 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 2013859 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 2013873 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2013873 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2013879 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@34103945
   [junit4]   2> 2013945 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:41454/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c770f7d); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 2013945 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 2013945 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@587f46fe[collection1] main]
   [junit4]   2> 2013945 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 2013946 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2013953 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 2013953 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 2013953 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 2013953 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1531142683514372096
   [junit4]   2> 2013954 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1531142683514372096
   [junit4]   2> 2013954 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 2013954 INFO  (searcherExecutor-3133-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@587f46fe[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2013954 INFO  (coreLoadExecutor-3132-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 2013963 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:43625 collection:control_collection shard:shard1
   [junit4]   2> 2013965 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2013967 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95696417144242180-core_node1-n_0000000000
   [junit4]   2> 2013967 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 2013973 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 2013974 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2013997 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2013997 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2013997 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43625/collection1/
   [junit4]   2> 2014014 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2014015 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:43625/collection1/ has no replicas
   [junit4]   2> 2014015 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2014016 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95696417144242180-core_node1-n_0000000000
   [junit4]   2> 2014018 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:43625",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 2014019 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43625/collection1/ shard1
   [junit4]   2> 2014121 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2014123 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:43625/collection1/ and leader is http://127.0.0.1:43625/collection1/
   [junit4]   2> 2014123 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43625
   [junit4]   2> 2014123 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2014123 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 2014123 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 2014124 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43625",
   [junit4]   2>   "node_name":"127.0.0.1:43625_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 2014124 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43625",
   [junit4]   2>   "node_name":"127.0.0.1:43625_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2014125 INFO  (coreZkRegister-3126-thread-1-processing-n:127.0.0.1:43625_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43625_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 2014369 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2014370 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2014377 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2014393 INFO  (zkCallback-1130-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cde2bbf name:ZooKeeperConnection Watcher:127.0.0.1:56495/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2014393 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2014393 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2014393 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2014394 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2014394 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2014653 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/cores/collection1
   [junit4]   2> 2014654 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001
   [junit4]   2> 2014655 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 2014879 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6fa7aa2f{/,null,AVAILABLE}
   [junit4]   2> 2014879 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6350edf{HTTP/1.1,[http/1.1]}{127.0.0.1:35181}
   [junit4]   2> 2014879 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.e.j.s.Server Started @2021026ms
   [junit4]   2> 2014879 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, hostContext=/, hostPort=35181, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/cores}
   [junit4]   2> 2014880 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 2014880 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001'
   [junit4]   2> 2014880 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2014880 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2014880 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2014889 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2014889 INFO  (zkCallback-1131-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@385b0424 name:ZooKeeperConnection Watcher:127.0.0.1:56495/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2014889 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2014890 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2014890 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2014890 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/solr.xml
   [junit4]   2> 2014894 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/cores
   [junit4]   2> 2014894 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CoreContainer New CoreContainer 1305299606
   [junit4]   2> 2014894 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001]
   [junit4]   2> 2014894 WARN  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/lib
   [junit4]   2> 2014895 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2014896 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 2014896 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2014896 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2014896 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56495/solr
   [junit4]   2> 2014896 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 2014896 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2014897 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2014904 INFO  (zkCallback-1134-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3669b025 name:ZooKeeperConnection Watcher:127.0.0.1:56495 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2014904 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2014905 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2014908 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2014908 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:35181_) [n:127.0.0.1:35181_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@451e94cd name:ZooKeeperConnection Watcher:127.0.0.1:56495/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2014908 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2014910 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2014911 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2014911 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2014912 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95696417144242184-127.0.0.1:35181_-n_0000000001
   [junit4]   2> 2014912 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95696417144242180-127.0.0.1:43625_-n_0000000000 to know if I could be the leader
   [junit4]   2> 2014912 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.ZkController Publish node=127.0.0.1:35181_ as DOWN
   [junit4]   2> 2014923 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35181_"} current state version: 4
   [junit4]   2> 2014923 INFO  (OverseerStateUpdate-95696417144242180-127.0.0.1:43625_-n_0000000000) [n:127.0.0.1:43625_    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35181_
   [junit4]   2> 2015025 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2015029 INFO  (zkCallback-1130-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2015029 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:35181_) [n:127.0.0.1:35181_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2015913 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35181_
   [junit4]   2> 2015918 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35181_
   [junit4]   2> 2015919 INFO  (zkCallback-1130-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2015919 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2015919 INFO  (zkCallback-1128-thread-1-processing-n:127.0.0.1:43625_) [n:127.0.0.1:43625_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2015919 INFO  (zkCallback-1130-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2015919 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:35181_) [n:127.0.0.1:35181_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2015919 INFO  (zkCallback-1135-thread-1-processing-n:127.0.0.1:35181_) [n:127.0.0.1:35181_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2015974 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 2015974 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 2015975 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/cores
   [junit4]   2> 2015975 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 2015975 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2/temp/solr.cloud.SharedFSAutoReplicaFailoverTest_B6CCE611E92FAA00-001/shard-1-001/cores/collection1
   [junit4]   2> 2015976 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 2016009 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J2
   [junit4]   2> 2016009 INFO  (TEST-SharedFSAutoReplicaFailoverTest.test-seed#[B6CCE611E92FAA00]) [n:127.0.0.1:35181_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 2016033 INFO  (coreLoadExecutor-3143-thread-1-processing-n:127.0.0.1:35181_) [n:127.0.0.1:35181_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 2016033 INFO  (coreLoadExecutor-3143-thread-1-processing-n:127.0.0.1:35181_) [n:127.0.0.1:35181_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 2016058 INFO  (OverseerStateUpdate-9569641714424218

[...truncated too long message...]

(CollectionsAPIDistributedZkTest.java:973)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22775, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46927/sdn: collection already exists: awholynewstresscollection_collection2_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B6CCE611E92FAA00]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22773, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46927/sdn: collection already exists: awholynewstresscollection_collection0_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B6CCE611E92FAA00]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22777, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46927/sdn: Could not find collection : awholynewstresscollection_collection4_0
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B6CCE611E92FAA00]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
   [junit4]   2> 3174983 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[B6CCE611E92FAA00]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=7, maxDocsPerChunk=276, blockSize=2), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=7, blockSize=2)), sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=ru-RU, timezone=America/Argentina/La_Rioja
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=167390560,total=500170752
   [junit4]   2> NOTE: All tests run in this JVM: [LukeRequestHandlerTest, RequestHandlersTest, FullSolrCloudDistribCmdsTest, TestSchemaResource, DateMathParserTest, XmlUpdateRequestHandlerTest, TestConfigSets, AddSchemaFieldsUpdateProcessorFactoryTest, TestFreeTextSuggestions, BlockDirectoryTest, TestStressRecovery, RecoveryZkTest, TestAddFieldRealTimeGet, TestConfigSetsAPIZkFailure, DistribJoinFromCollectionTest, DistributedExpandComponentTest, TestSortByMinMaxFunction, AutoCommitTest, TestJmxMonitoredMap, HighlighterMaxOffsetTest, CollectionStateFormat2Test, TestLRUStatsCache, SparseHLLTest, TestSolrCLIRunExample, TestSolrIndexConfig, TestSmileRequest, TestSha256AuthenticationProvider, TestReloadAndDeleteDocs, SuggesterWFSTTest, TestDistributedMissingSort, TestDynamicFieldResource, TestReversedWildcardFilterFactory, StatsComponentTest, TestInfoStreamLogging, TestGroupingSearch, DirectSolrConnectionTest, TestSolrDynamicMBean, SolrCoreCheckLockOnStartupTest, AssignTest, TestExceedMaxTermLength, QueryParsingTest, OverseerTest, TestDownShardTolerantSearch, TestPostingsSolrHighlighter, TestSuggestSpellingConverter, TestSortingResponseWriter, MultiThreadedOCPTest, DocExpirationUpdateProcessorFactoryTest, ShowFileRequestHandlerTest, SuggesterTSTTest, NoCacheHeaderTest, ExitableDirectoryReaderTest, HardAutoCommitTest, CircularListTest, SecurityConfHandlerTest, TestFieldTypeCollectionResource, StatelessScriptUpdateProcessorFactoryTest, TestRequestStatusCollectionAPI, TestFilteredDocIdSet, TestCloudSchemaless, TestIndexingPerformance, ClusterStateTest, TestPerFieldSimilarityWithDefaultOverride, TestMaxScoreQueryParser, CdcrRequestHandlerTest, HdfsTlogReplayBufferedWhileIndexingTest, TestPerFieldSimilarity, TestSolrJ, SuggestComponentTest, TestCharFilters, TestRebalanceLeaders, TestIndexSearcher, TestExtendedDismaxParser, TestJsonFacets, SampleTest, MergeStrategyTest, TestBlobHandler, CoreAdminRequestStatusTest, TestOverriddenPrefixQueryForCustomFieldType, DirectUpdateHandlerOptimizeTest, CoreAdminHandlerTest, TestConfigOverlay, SharedFSAutoReplicaFailoverTest, TestFastWriter, DocValuesMultiTest, LeaderInitiatedRecoveryOnCommitTest, TestCollationField, TestUniqueKeyFieldResource, TestSerializedLuceneMatchVersion, OverseerCollectionConfigSetProcessorTest, SolrTestCaseJ4Test, TestPivotHelperCode, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [223/579 (2!)] on J2 in 558.08s, 1 test, 1 error <<< FAILURES!

[...truncated 1164 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 1 error, 1 failure, 31 ignored (16 assumptions) [seed: B6CCE611E92FAA00]

Total time: 298 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 8 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/8/

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestLeaderElectionZkExpiry

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.TestLeaderElectionZkExpiry:     1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestLeaderElectionZkExpiry: 
   1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([FEDE368F0FF06FF3]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestLeaderElectionZkExpiry

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]         at java.lang.Throwable.getStackTraceElement(Native Method)         at java.lang.Throwable.getOurStackTrace(Throwable.java:827)         at java.lang.Throwable.printStackTrace(Throwable.java:656)         at java.lang.Throwable.printStackTrace(Throwable.java:721)         at org.apache.solr.common.SolrException.toStr(SolrException.java:179)         at org.apache.solr.common.SolrException.log(SolrException.java:153)         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:133)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Throwable.getStackTraceElement(Native Method)
        at java.lang.Throwable.getOurStackTrace(Throwable.java:827)
        at java.lang.Throwable.printStackTrace(Throwable.java:656)
        at java.lang.Throwable.printStackTrace(Throwable.java:721)
        at org.apache.solr.common.SolrException.toStr(SolrException.java:179)
        at org.apache.solr.common.SolrException.log(SolrException.java:153)
        at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:133)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([FEDE368F0FF06FF3]:0)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
replicaCount expected:<0> but was:<1>

Stack Trace:
java.lang.AssertionError: replicaCount expected:<0> but was:<1>
	at __randomizedtesting.SeedInfo.seed([FEDE368F0FF06FF3:768A0955A10C020B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoConfigSetExist(CollectionsAPIDistributedZkTest.java:604)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:166)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:42627/qc_mg/it

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42627/qc_mg/it
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:382)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:498)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 47 more




Build Log:
[...truncated 11102 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/init-core-data-001
   [junit4]   2> 111491 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 111491 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_o/vk
   [junit4]   2> 113949 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 115543 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 116575 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 116584 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 116839 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 116965 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_56866_hdfs____.sxky3j/webapp
   [junit4]   2> 117823 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 119050 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56866
   [junit4]   2> 123188 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 123203 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 123216 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_36627_datanode____.w1076p/webapp
   [junit4]   2> 123369 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 123922 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36627
   [junit4]   2> 124420 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 124421 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 124437 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34218_datanode____up7wsf/webapp
   [junit4]   2> 124600 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 125266 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[FEDE368F0FF06FF3]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34218
   [junit4]   2> 128444 INFO  (IPC Server handler 6 on 34431) [    ] BlockStateChange BLOCK* processReport: from storage DS-4353d508-76c7-4eb2-9f69-e3a5d95a82be node DatanodeRegistration(127.0.0.1, datanodeUuid=21d75045-7564-4d0e-a20d-8c14e6c925e3, infoPort=34218, ipcPort=40318, storageInfo=lv=-56;cid=testClusterID;nsid=1589054835;c=0), blocks: 0, hasStaleStorages: true, processing time: 3 msecs
   [junit4]   2> 128470 INFO  (IPC Server handler 6 on 34431) [    ] BlockStateChange BLOCK* processReport: from storage DS-aa4d7f2d-0f7b-405b-a7d7-0bd6c4742faf node DatanodeRegistration(127.0.0.1, datanodeUuid=21d75045-7564-4d0e-a20d-8c14e6c925e3, infoPort=34218, ipcPort=40318, storageInfo=lv=-56;cid=testClusterID;nsid=1589054835;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 128444 INFO  (IPC Server handler 2 on 34431) [    ] BlockStateChange BLOCK* processReport: from storage DS-31499e54-79e8-4e7f-bc81-ae9c7ee6ea73 node DatanodeRegistration(127.0.0.1, datanodeUuid=4e311165-e8a3-4301-9699-a14f5e52c12d, infoPort=36627, ipcPort=46873, storageInfo=lv=-56;cid=testClusterID;nsid=1589054835;c=0), blocks: 0, hasStaleStorages: true, processing time: 1365 msecs
   [junit4]   2> 128493 INFO  (IPC Server handler 2 on 34431) [    ] BlockStateChange BLOCK* processReport: from storage DS-510b8198-38e5-4dac-bcdb-a22fc142a042 node DatanodeRegistration(127.0.0.1, datanodeUuid=4e311165-e8a3-4301-9699-a14f5e52c12d, infoPort=36627, ipcPort=46873, storageInfo=lv=-56;cid=testClusterID;nsid=1589054835;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 129439 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 129440 INFO  (Thread-304) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 129440 INFO  (Thread-304) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 129541 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.ZkTestServer start zk server on port:44545
   [junit4]   2> 129541 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 129553 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 129588 INFO  (zkCallback-90-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@35485c7f name:ZooKeeperConnection Watcher:127.0.0.1:44545 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129589 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 129589 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 129589 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 129593 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 129594 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 129598 INFO  (zkCallback-91-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@db8158a name:ZooKeeperConnection Watcher:127.0.0.1:44545/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129598 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 129598 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 129598 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 129602 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 129603 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 129603 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 129604 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 129605 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 129606 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 129606 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 129608 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 129608 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 129609 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 129609 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 129610 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 129610 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 129611 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 129611 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 129612 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 129612 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 129613 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 129613 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 129614 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 129614 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 129615 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 129615 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 129616 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 129616 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 129905 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores/collection1
   [junit4]   2> 129925 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 129960 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3343dfaf{/_o/vk,null,AVAILABLE}
   [junit4]   2> 129960 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.ServerConnector Started ServerConnector@219dd270{HTTP/1.1,[http/1.1]}{127.0.0.1:51422}
   [junit4]   2> 129961 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.Server Started @135109ms
   [junit4]   2> 129961 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:34431/hdfs__localhost_34431__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001_tempDir-002_control_data, hostContext=/_o/vk, hostPort=51422, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores}
   [junit4]   2> 129961 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 129969 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001'
   [junit4]   2> 129969 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 129969 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 129970 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 129977 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 129985 INFO  (zkCallback-92-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1088200a name:ZooKeeperConnection Watcher:127.0.0.1:44545/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 129986 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 129986 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 129987 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 129987 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/solr.xml
   [junit4]   2> 129993 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores
   [junit4]   2> 129993 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.CoreContainer New CoreContainer 1373956356
   [junit4]   2> 129993 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001]
   [junit4]   2> 129993 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/lib
   [junit4]   2> 129994 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 129995 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 129995 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 129995 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 129995 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44545/solr
   [junit4]   2> 129995 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 129995 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 129996 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 129997 INFO  (zkCallback-95-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ef2dc44 name:ZooKeeperConnection Watcher:127.0.0.1:44545 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 130001 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 130001 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 130003 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 130006 INFO  (zkCallback-96-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@188871c name:ZooKeeperConnection Watcher:127.0.0.1:44545/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 130006 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 130007 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 130008 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 130009 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 130012 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 130013 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 130014 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 130015 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 130016 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 130016 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 130017 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 130018 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 130019 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 130020 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 130021 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 130022 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000
   [junit4]   2> 130022 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51422__o%2Fvk
   [junit4]   2> 130022 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 130023 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer Overseer (id=95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) starting
   [junit4]   2> 130024 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 130028 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 130028 INFO  (OverseerCollectionConfigSetProcessor-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 130029 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 130029 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51422__o%2Fvk
   [junit4]   2> 130030 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51422__o%2Fvk
   [junit4]   2> 130031 INFO  (zkCallback-96-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 130031 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 130031 INFO  (zkCallback-96-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 130039 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 130039 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 130041 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores
   [junit4]   2> 130061 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 130061 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores/collection1
   [junit4]   2> 130061 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 130085 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 130085 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 130085 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 130085 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 130119 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51422/_o/vk",
   [junit4]   2>   "node_name":"127.0.0.1:51422__o%2Fvk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 130120 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 130119 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51422/_o/vk",
   [junit4]   2>   "node_name":"127.0.0.1:51422__o%2Fvk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 130121 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 130122 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 130124 INFO  (zkCallback-96-thread-2-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 131120 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 131120 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 131121 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 131121 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 131121 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 131121 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores/collection1'
   [junit4]   2> 131121 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 131121 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 131123 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 131149 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 131152 WARN  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 131152 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 131171 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 131186 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 131266 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 131271 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 131272 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 131280 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 131282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 131283 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 131283 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 131284 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 131285 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 131285 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 131292 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:34431/solr_hdfs_home
   [junit4]   2> 131292 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 131292 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/control-001/cores/collection1], dataDir=[hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 131292 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@70253fb0
   [junit4]   2> 131292 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 131458 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 131462 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 131539 WARN  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:34431/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 131539 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 131595 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 131595 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.297768791850966]
   [junit4]   2> 132345 INFO  (IPC Server handler 7 on 34431) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:48385 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-aa4d7f2d-0f7b-405b-a7d7-0bd6c4742faf:NORMAL:127.0.0.1:36829|RBW], ReplicaUnderConstruction[[DISK]DS-31499e54-79e8-4e7f-bc81-ae9c7ee6ea73:NORMAL:127.0.0.1:48385|RBW]]} size 71
   [junit4]   2> 132347 INFO  (IPC Server handler 8 on 34431) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36829 is added to blk_1073741825_1001 size 71
   [junit4]   2> 132894 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@32b8fc74; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 132895 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 132898 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 132900 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 132901 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 132901 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 132901 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 132901 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 132901 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 132901 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 132902 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 132902 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 132902 WARN  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 132903 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 132904 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 132916 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 132928 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 132933 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 132933 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 132940 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 132940 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 132994 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 132994 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 133017 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@af06901
   [junit4]   2> 133270 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@hdfs://localhost:34431/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@32b8fc74; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 133271 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 133271 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@877df7e[collection1] main]
   [junit4]   2> 133271 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 133277 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 133277 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 133278 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 133278 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 133278 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 133278 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 133278 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 133278 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 133280 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 133281 INFO  (searcherExecutor-221-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@877df7e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 133281 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 133282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 133282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 133282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1531036216774885376
   [junit4]   2> 133282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1531036216774885376
   [junit4]   2> 133282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 133282 INFO  (coreLoadExecutor-220-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 133289 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:51422/_o/vk collection:control_collection shard:shard1
   [junit4]   2> 133301 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 133337 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95689763296903172-core_node1-n_0000000000
   [junit4]   2> 133345 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 133362 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 133362 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 133362 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51422/_o/vk/collection1/
   [junit4]   2> 133362 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 133362 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:51422/_o/vk/collection1/ has no replicas
   [junit4]   2> 133363 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 133364 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95689763296903172-core_node1-n_0000000000
   [junit4]   2> 133365 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51422/_o/vk/collection1/ shard1
   [junit4]   2> 133377 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 133390 INFO  (zkCallback-96-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 133406 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer processMessage: queueSize: 0, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:51422/_o/vk",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 133510 INFO  (zkCallback-96-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 133533 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:51422/_o/vk/collection1/ and leader is http://127.0.0.1:51422/_o/vk/collection1/
   [junit4]   2> 133533 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51422/_o/vk
   [junit4]   2> 133533 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 133533 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 133533 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 133535 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51422/_o/vk",
   [junit4]   2>   "node_name":"127.0.0.1:51422__o%2Fvk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 133535 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:51422/_o/vk",
   [junit4]   2>   "node_name":"127.0.0.1:51422__o%2Fvk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 133536 INFO  (coreZkRegister-214-thread-1-processing-n:127.0.0.1:51422__o%2Fvk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51422__o%2Fvk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 133603 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 133603 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 133607 INFO  (zkCallback-98-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@413f4c3c name:ZooKeeperConnection Watcher:127.0.0.1:44545/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133608 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 133608 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 133608 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 133609 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 133610 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 133610 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 133610 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 133611 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 133613 INFO  (zkCallback-99-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@77972c1 name:ZooKeeperConnection Watcher:127.0.0.1:44545/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133613 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 133613 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 133617 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 133617 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 133622 INFO  (zkCallback-96-thread-1-processing-n:127.0.0.1:51422__o%2Fvk) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 133622 INFO  (zkCallback-98-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 133820 INFO  (OverseerStateUpdate-95689763296903172-127.0.0.1:51422__o%2Fvk-n_0000000000) [n:127.0.0.1:51422__o%2Fvk    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 133850 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/shard-1-001/cores/collection1
   [junit4]   2> 133851 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/shard-1-001
   [junit4]   2> 133852 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 133854 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d569adf{/_o/vk,null,AVAILABLE}
   [junit4]   2> 133855 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.ServerConnector Started ServerConnector@5a66beac{HTTP/1.1,[http/1.1]}{127.0.0.1:57492}
   [junit4]   2> 133855 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.e.j.s.Server Started @139003ms
   [junit4]   2> 133855 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:34431/hdfs__localhost_34431__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/_o/vk, hostPort=57492, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/shard-1-001/cores}
   [junit4]   2> 133856 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 133856 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_FEDE368F0FF06FF3-001/shard-1-001'
   [junit4]   2> 133856 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 133856 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 133856 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 133857 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 133878 INFO  (zkCallback-100-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@26aeefb8 name:ZooKeeperConnection Watcher:127.0.0.1:44545/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133878 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[FEDE368F0FF06FF3]) [    ] o.a.s.c.c.ConnectionManager Client is

[...truncated too long message...]

perException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:694)
   [junit4]   2> 	... 3 more
   [junit4]   2> 
   [junit4]   2> 3957793 ERROR (OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001) [n:dummy.host.com:8984_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread OverseerAutoReplicaFailoverThread had an error in its thread work loop.:org.apache.solr.common.SolrException: Error reading cluster properties
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:703)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(OverseerAutoReplicaFailoverThread.java:152)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:131)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterprops.json
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:694)
   [junit4]   2> 	... 3 more
   [junit4]   2> 
   [junit4]   2> Apr 08, 2016 11:09:01 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Throwable.getStackTraceElement(Native Method)
   [junit4]   2>         at java.lang.Throwable.getOurStackTrace(Throwable.java:827)
   [junit4]   2>         at java.lang.Throwable.printStackTrace(Throwable.java:656)
   [junit4]   2>         at java.lang.Throwable.printStackTrace(Throwable.java:721)
   [junit4]   2>         at org.apache.solr.common.SolrException.toStr(SolrException.java:179)
   [junit4]   2>         at org.apache.solr.common.SolrException.log(SolrException.java:153)
   [junit4]   2>         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:133)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=536, maxMBSortInHeap=6.351389922865323, sim=ClassicSimilarity, locale=ga-IE, timezone=PLT
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=162236944,total=503316480
   [junit4]   2> NOTE: All tests run in this JVM: [TestSystemIdResolver, ShardRoutingTest, ConfigSetsAPITest, CloneFieldUpdateProcessorFactoryTest, HdfsCollectionsAPIDistributedZkTest, LoggingHandlerTest, CollectionsAPIAsyncDistributedZkTest, TestCodecSupport, TestEmbeddedSolrServerConstructors, DistributedIntervalFacetingTest, TestSimpleTrackingShardHandler, DistributedDebugComponentTest, TestQuerySenderNoQuery, TestJsonRequest, JavabinLoaderTest, ClusterStateUpdateTest, TestCoreContainer, CollectionsAPIDistributedZkTest, AliasIntegrationTest, BlockJoinFacetDistribTest, TestIntervalFaceting, SpellingQueryConverterTest, OverseerStatusTest, OverriddenZkACLAndCredentialsProvidersTest, SimplePostToolTest, DistributedTermsComponentTest, TimeZoneUtilsTest, DistanceFunctionTest, TestStandardQParsers, MBeansHandlerTest, MigrateRouteKeyTest, TestPerFieldSimilarityClassic, VersionInfoTest, TestClassicSimilarityFactory, TestFiltering, HdfsBasicDistributedZkTest, TestSizeLimitedDistributedMap, FileUtilsTest, AsyncMigrateRouteKeyTest, WordBreakSolrSpellCheckerTest, DistributedFacetPivotWhiteBoxTest, ZkStateReaderTest, TestExpandComponent, RequestLoggingTest, DirectoryFactoryTest, TestSQLHandler, TestQueryUtils, RemoteQueryErrorTest, TestCollapseQParserPlugin, TestDocBasedVersionConstraints, DateRangeFieldTest, ZkSolrClientTest, AnalysisErrorHandlingTest, FastVectorHighlighterTest, SuggesterFSTTest, CSVRequestHandlerTest, DistributedMLTComponentTest, ParsingFieldUpdateProcessorsTest, TestRecoveryHdfs, TestManagedResourceStorage, SuggestComponentContextFilterQueryTest, IndexBasedSpellCheckerTest, SpellCheckComponentTest, SolrIndexSplitterTest, TestCloudPivotFacet, TestBM25SimilarityFactory, TestReplicationHandlerBackup, NumericFieldsTest, TestDistribDocBasedVersion, TestAuthenticationFramework, GraphQueryTest, ZkControllerTest, MultiTermTest, TestRandomRequestDistribution, LeaderFailoverAfterPartitionTest, TestFieldSortValues, TestManagedSynonymFilterFactory, OpenCloseCoreStressTest, InfoHandlerTest, TestStressVersions, ShardRoutingCustomTest, CdcrReplicationHandlerTest, BasicFunctionalityTest, ConjunctionSolrSpellCheckerTest, QueryResultKeyTest, ChaosMonkeySafeLeaderTest, TestNoOpRegenerator, DocumentBuilderTest, TestRuleBasedAuthorizationPlugin, TestLeaderElectionZkExpiry]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLeaderElectionZkExpiry -Dtests.seed=FEDE368F0FF06FF3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ga-IE -Dtests.timezone=PLT -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestLeaderElectionZkExpiry (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.TestLeaderElectionZkExpiry: 
   [junit4]    >    1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FEDE368F0FF06FF3]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=111479, name=OverseerHdfsCoreFailoverThread-95690011904901129-dummy.host.com:8984_solr-n_0000000001, state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Throwable.getStackTraceElement(Native Method)
   [junit4]    >         at java.lang.Throwable.getOurStackTrace(Throwable.java:827)
   [junit4]    >         at java.lang.Throwable.printStackTrace(Throwable.java:656)
   [junit4]    >         at java.lang.Throwable.printStackTrace(Throwable.java:721)
   [junit4]    >         at org.apache.solr.common.SolrException.toStr(SolrException.java:179)
   [junit4]    >         at org.apache.solr.common.SolrException.log(SolrException.java:153)
   [junit4]    >         at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:133)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FEDE368F0FF06FF3]:0)
   [junit4] Completed [431/579 (3!)] on J1 in 35.09s, 1 test, 2 errors <<< FAILURES!

[...truncated 464 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 2 suite-level errors, 1 error, 1 failure, 484 ignored (9 assumptions) [seed: FEDE368F0FF06FF3]

Total time: 267 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 7 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/7/

3 tests failed.
FAILED:  org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([1ABE324BFDA11B34:F3E4897363388B9C]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:775)
	at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:107)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=*[count(//doc)=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:768)
	... 41 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=11278, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=11278, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46649: collection already exists: awholynewstresscollection_collection3_0
	at __randomizedtesting.SeedInfo.seed([1ABE324BFDA11B34]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=18093, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18093, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.common.SolrException: Error reading cluster properties
	at __randomizedtesting.SeedInfo.seed([1ABE324BFDA11B34]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:703)
	at org.apache.solr.common.cloud.ZkStateReader.getBaseUrlForNodeName(ZkStateReader.java:797)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:998)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterprops.json
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:694)
	... 6 more




Build Log:
[...truncated 11060 lines...]
   [junit4] Suite: org.apache.solr.core.TestArbitraryIndexDir
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001
   [junit4]   2> 41537 INFO  (SUITE-TestArbitraryIndexDir-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 41550 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLoadNewIndexDir
   [junit4]   2> 41550 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 41550 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 41550 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 41550 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr
   [junit4]   2> 41551 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 41551 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 41603 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 41621 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 41656 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 41679 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 42153 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 42153 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 42154 WARN  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 42179 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 42181 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 42182 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 42182 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr
   [junit4]   2> 42182 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr'
   [junit4]   2> 42182 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 42182 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr
   [junit4]   2> 42183 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer New CoreContainer 1235293656
   [junit4]   2> 42183 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr]
   [junit4]   2> 42183 WARN  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/lib
   [junit4]   2> 42183 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 42185 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 42185 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 42185 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 42185 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 42185 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 42187 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema12.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001, shard=shard1}
   [junit4]   2> 42194 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 42194 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 42194 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr
   [junit4]   2> 42195 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 42195 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 42219 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 42233 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 42249 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 42256 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 42539 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 42540 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 42540 WARN  (coreLoadExecutor-82-thread-1) [    ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 42561 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 42563 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 42567 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 42567 INFO  (coreLoadExecutor-82-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1
   [junit4]   2> 42567 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockFSDirectoryFactory
   [junit4]   2> 42568 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/]
   [junit4]   2> 42568 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.JmxMonitoredMap No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 42573 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001
   [junit4]   2> 42578 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index/
   [junit4]   2> 42578 WARN  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 42581 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index
   [junit4]   2> 42581 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=774918193, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 42589 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56bf302d),segFN=segments_1,generation=1}
   [junit4]   2> 42590 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 42598 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 42599 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 42599 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 42599 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 42599 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 42602 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 42604 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 42604 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 42606 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 42609 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 42617 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,/export,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/sql,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
   [junit4]   2> 42617 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 42629 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 42629 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 42629 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/
   [junit4]   2> 42637 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=46, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 42637 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56bf302d),segFN=segments_1,generation=1}
   [junit4]   2> 42637 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 42637 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1acec8c7[collection1] main]
   [junit4]   2> 42638 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 42638 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 42638 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 42638 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 42644 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 42742 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 42742 INFO  (coreLoadExecutor-82-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 42743 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 42745 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{add=[1]} 0 1
   [junit4]   2> 42746 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 42747 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 42747 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 42747 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 42747 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 42747 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 42747 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 42748 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 42748 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 42748 INFO  (searcherExecutor-83-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1acec8c7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 42782 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 43046 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56bf302d),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56bf302d),segFN=segments_2,generation=2}
   [junit4]   2> 43047 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 43048 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrCore New index directory detected: old=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index/ new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp
   [junit4]   2> 43049 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@56f2b9e[collection1] main]
   [junit4]   2> 43049 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 43049 INFO  (searcherExecutor-83-thread-1) [    ] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@56f2b9e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
   [junit4]   2> 43051 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=null path=null params={}{commit=} 0 269
   [junit4]   2> 43057 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 43057 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 43057 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr
   [junit4]   2> 43057 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 43057 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader Adding 'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 43106 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 43132 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 43244 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 43276 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 43628 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 43628 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 43629 WARN  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 43651 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 43653 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 43655 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1'
   [junit4]   2> 43655 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1
   [junit4]   2> 43690 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/]
   [junit4]   2> 43690 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.JmxMonitoredMap No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 43691 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp
   [junit4]   2> 43697 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/
   [junit4]   2> 43703 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory Found 1 old index directories to clean-up under /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/
   [junit4]   2> 43703 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Cannot delete directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index as it is still being referenced in the cache!
   [junit4]   2> 43703 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory Delete old index directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index failed.
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 43704 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 43705 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 43705 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 43705 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 43706 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 43707 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 43707 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 43708 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 43730 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 43730 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,spellCheckCompRH,lazy,/update/json/docs,/admin/luke,/export,spellCheckWithWordbreak_Direct,tvrh,/get,/admin/properties,/update/json,mltrh,/admin/threads,/search-facet-def,/update/csv,/sql,/search-facet-invariants,/admin/segments,spellCheckCompRH1,/mlt,/admin/system,/replication,dismax,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,spellCheckWithWordbreak,mock,/admin/ping,/update,/admin/file,/terms,spellCheckCompRH_Direct,/debug/dump
   [junit4]   2> 43731 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 43740 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 43740 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 43741 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@58a94d54[collection1] main]
   [junit4]   2> 43741 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 43741 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 43741 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 43742 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 43742 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 43747 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 43748 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.DefaultSolrCoreState Closing old IndexWriter... core=collection1
   [junit4]   2> 43750 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp
   [junit4]   2> 43750 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 43765 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 43766 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 43767 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 43768 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@58a94d54[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
   [junit4]   2> 43785 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@70e7004d),segFN=segments_1,generation=1}
   [junit4]   2> 43785 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 43789 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 43790 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5174d73f[collection1] main]
   [junit4]   2> 43791 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.CoreContainer replacing core: collection1
   [junit4]   2> 43791 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@73d20658
   [junit4]   2> 43791 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 43791 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 43792 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=null path=null params={q=id:2&qt=standard&start=0&rows=20&version=2.2} hits=0 status=0 QTime=0
   [junit4]   2> 43793 ERROR (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: xpath=*[count(//doc)=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
   [junit4]   2> 43817 INFO  (searcherExecutor-87-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5174d73f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
   [junit4]   2> 43818 ERROR (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.SolrTestCaseJ4 REQUEST FAILED: q=id:2&qt=standard&start=0&rows=20&version=2.2:java.lang.RuntimeException: REQUEST FAILED: xpath=*[count(//doc)=1]
   [junit4]   2> 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> <response>
   [junit4]   2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]   2> </response>
   [junit4]   2> 
   [junit4]   2> 	request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
   [junit4]   2> 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:768)
   [junit4]   2> 	at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:107)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 43819 INFO  (TEST-TestArbitraryIndexDir.testLoadNewIndexDir-seed#[1ABE324BFDA11B34]) [    x:collection1] o.a.s.SolrTestCaseJ4 ###Ending testLoadNewIndexDir
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestArbitraryIndexDir -Dtests.method=testLoadNewIndexDir -Dtests.seed=1ABE324BFDA11B34 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sr-ME -Dtests.timezone=Indian/Mayotte -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   2.28s J0 | TestArbitraryIndexDir.testLoadNewIndexDir <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1ABE324BFDA11B34:F3E4897363388B9C]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:775)
   [junit4]    > 	at org.apache.solr.core.TestArbitraryIndexDir.testLoadNewIndexDir(TestArbitraryIndexDir.java:107)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=*[count(//doc)=1]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
   [junit4]    > </response>
   [junit4]    > 	request was:q=id:2&qt=standard&start=0&rows=20&version=2.2
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:768)
   [junit4]    > 	... 41 more
   [junit4]   2> 43821 INFO  (SUITE-TestArbitraryIndexDir-seed#[1ABE324BFDA11B34]-worker) [    x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 43821 INFO  (SUITE-TestArbitraryIndexDir-seed#[1ABE324BFDA11B34]-worker) [    x:collection1] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1235293656
   [junit4]   2> 43857 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@63ca2390
   [junit4]   2> 43858 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 43858 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 43858 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 43858 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 44043 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 44043 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockFSDirectoryFactory - 3 directories currently being tracked
   [junit4]   2> 44043 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp;done=false>>]
   [junit4]   2> 44043 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index_temp
   [junit4]   2> 44265 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001;done=false>>]
   [junit4]   2> 44265 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001
   [junit4]   2> 44273 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 44273 INFO  (coreCloseExecutor-91-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001/init-core-data-001/index
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J0/temp/solr.core.TestArbitraryIndexDir_1ABE324BFDA11B34-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=sr-ME, timezone=Indian/Mayotte
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=134366824,total=315621376
   [junit4]   2> NOTE: All tests run in this JVM: [HLLSerializationTest, DocumentAnalysisRequestHandlerTest, ResponseHeaderTest, AtomicUpdatesTest, TestConfig, TestIBSimilarityFactory, TestTrieFacet, DateFieldTest, TestArbitraryIndexDir]
   [junit4] Completed [23/579 (1!)] on J0 in 3.03s, 1 test, 1 error <<< FAILURES!

[...truncated 481 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/init-core-data-001
   [junit4]   2> 1135102 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1135102 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1135371 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1135397 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1135400 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1135420 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_52444_hdfs____5mfrtt/webapp
   [junit4]   2> 1135519 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1136033 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:52444
   [junit4]   2> 1136430 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1136431 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1136466 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_53803_datanode____.i021fg/webapp
   [junit4]   2> 1136648 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1137298 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53803
   [junit4]   2> 1137495 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1137496 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1137516 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_51178_datanode____pp0e59/webapp
   [junit4]   2> 1137592 INFO  (IPC Server handler 3 on 36325) [    ] BlockStateChange BLOCK* processReport: from storage DS-66df558a-c0b0-4477-8cf8-390e87ac0f6c node DatanodeRegistration(127.0.0.1, datanodeUuid=4495c4ea-b15f-4cd9-8001-e8727ac2c2a2, infoPort=53803, ipcPort=50760, storageInfo=lv=-56;cid=testClusterID;nsid=590772488;c=0), blocks: 0, hasStaleStorages: true, processing time: 2 msecs
   [junit4]   2> 1137592 INFO  (IPC Server handler 3 on 36325) [    ] BlockStateChange BLOCK* processReport: from storage DS-2b719314-3e50-46db-828f-8368c2474a2a node DatanodeRegistration(127.0.0.1, datanodeUuid=4495c4ea-b15f-4cd9-8001-e8727ac2c2a2, infoPort=53803, ipcPort=50760, storageInfo=lv=-56;cid=testClusterID;nsid=590772488;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 1137785 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1138141 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:51178
   [junit4]   2> 1138957 INFO  (IPC Server handler 9 on 36325) [    ] BlockStateChange BLOCK* processReport: from storage DS-9c2c8a83-4e0d-4b4c-a43b-c97c50a0856d node DatanodeRegistration(127.0.0.1, datanodeUuid=3de7b29f-ea5e-4422-a63e-dabdb1857b8a, infoPort=51178, ipcPort=60796, storageInfo=lv=-56;cid=testClusterID;nsid=590772488;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 1139045 INFO  (IPC Server handler 9 on 36325) [    ] BlockStateChange BLOCK* processReport: from storage DS-37538dc2-79b4-4c0f-9b9a-6f47d5e7e72c node DatanodeRegistration(127.0.0.1, datanodeUuid=3de7b29f-ea5e-4422-a63e-dabdb1857b8a, infoPort=51178, ipcPort=60796, storageInfo=lv=-56;cid=testClusterID;nsid=590772488;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 1139097 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1139100 INFO  (Thread-6322) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1139100 INFO  (Thread-6322) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1139320 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.ZkTestServer start zk server on port:40169
   [junit4]   2> 1139320 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1139324 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1139337 INFO  (zkCallback-1084-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4342438a name:ZooKeeperConnection Watcher:127.0.0.1:40169 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1139337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1139337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1139337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1139374 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x153ee83cc530000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1139374 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1139388 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1139424 INFO  (zkCallback-1085-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14861e4 name:ZooKeeperConnection Watcher:127.0.0.1:40169/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1139424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1139424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1139424 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1139464 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1139466 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1139470 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1139471 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1139471 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1139481 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1139481 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1139482 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1139482 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1139483 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1139483 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1139484 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1139484 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1139484 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1139485 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1139485 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1139485 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1139486 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1139486 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1139487 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1139487 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1139488 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1139488 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1139496 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1139497 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1139618 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001/cores/collection1
   [junit4]   2> 1139619 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1139625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d879caa{/,null,AVAILABLE}
   [junit4]   2> 1139625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.e.j.s.ServerConnector Started ServerConnector@5a99bb5{HTTP/1.1,[http/1.1]}{127.0.0.1:58068}
   [junit4]   2> 1139625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.e.j.s.Server Started @1146257ms
   [junit4]   2> 1139625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:36325/hdfs__localhost_36325__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.0_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001_tempDir-002_control_data, hostContext=/, hostPort=58068, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001/cores}
   [junit4]   2> 1139625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1139625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001'
   [junit4]   2> 1139626 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1139626 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1139626 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1139648 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1139812 INFO  (zkCallback-1086-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67483e50 name:ZooKeeperConnection Watcher:127.0.0.1:40169/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1139812 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1139813 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1139824 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1139824 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001/solr.xml
   [junit4]   2> 1139828 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001/cores
   [junit4]   2> 1139828 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer New CoreContainer 1310515459
   [junit4]   2> 1139828 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001]
   [junit4]   2> 1139828 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_1ABE324BFDA11B34-001/control-001/lib
   [junit4]   2> 1139828 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1139829 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1139829 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1139830 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1139830 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40169/solr
   [junit4]   2> 1139830 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1139830 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1139864 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1139872 INFO  (zkCallback-1089-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3422f636 name:ZooKeeperConnection Watcher:127.0.0.1:40169 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1139872 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1139872 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1139888 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1139900 INFO  (zkCallback-1090-thread-1-processing-n:127.0.0.1:58068_) [n:127.0.0.1:58068_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17b45d23 name:ZooKeeperConnection Watcher:127.0.0.1:40169/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1139900 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1139904 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1139924 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1139956 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1139976 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1140000 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1140024 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1140036 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1140048 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1140062 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1140076 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE324BFDA11B34]) [n:127.0.0.1:58068_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1140092 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[1ABE32

[...truncated too long message...]

/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=test -Dtests.seed=1ABE324BFDA11B34 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=vi -Dtests.timezone=Europe/Simferopol -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    538s J1 | CollectionsAPIDistributedZkTest.test <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18093, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.common.SolrException: Error reading cluster properties
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1ABE324BFDA11B34]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:703)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getBaseUrlForNodeName(ZkStateReader.java:797)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:998)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
   [junit4]    > Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterprops.json
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:694)
   [junit4]    > 	... 6 moreThrowable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18088, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.common.SolrException: Error reading cluster properties
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1ABE324BFDA11B34]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:703)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getBaseUrlForNodeName(ZkStateReader.java:797)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:998)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
   [junit4]    > Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterprops.json
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:314)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:311)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:694)
   [junit4]    > 	... 6 more
   [junit4]   2> 3020779 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[1ABE324BFDA11B34]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=FST50, _version_=Lucene50(blocksize=128), multiDefault=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), intDefault=Lucene50(blocksize=128), a_i1=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=FST50, range_facet_i_dv=PostingsFormat(name=LuceneVarGapDocFreqInterval), text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l=PostingsFormat(name=LuceneVarGapDocFreqInterval), timestamp=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=42, maxMBSortInHeap=4.531956248987799, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=vi, timezone=Europe/Simferopol
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=233626688,total=512229376
   [junit4]   2> NOTE: All tests run in this JVM: [HLLUtilTest, MoreLikeThisHandlerTest, AnalysisErrorHandlingTest, UniqFieldsUpdateProcessorFactoryTest, TestCoreContainer, SpellCheckCollatorTest, TestPerFieldSimilarityClassic, NotRequiredUniqueKeyTest, TestCodecSupport, OpenExchangeRatesOrgProviderTest, TestStressVersions, TestLeaderElectionZkExpiry, TestSurroundQueryParser, TestWordDelimiterFilterFactory, DOMUtilTest, AliasIntegrationTest, SpatialRPTFieldTypeTest, TestBinaryResponseWriter, LoggingHandlerTest, SimplePostToolTest, TestHashPartitioner, CollectionsAPIAsyncDistributedZkTest, CheckHdfsIndexTest, TestFieldSortValues, SolrIndexSplitterTest, TestManagedSynonymFilterFactory, LeaderFailoverAfterPartitionTest, TestPartialUpdateDeduplication, SolrCmdDistributorTest, TestMiniSolrCloudClusterBase, ChaosMonkeyNothingIsSafeTest, TestQueryTypes, DistributedTermsComponentTest, TestLMJelinekMercerSimilarityFactory, GraphQueryTest, ExplicitHLLTest, DeleteShardTest, TestBM25SimilarityFactory, DeleteInactiveReplicaTest, DistribDocExpirationUpdateProcessorTest, TestAuthenticationFramework, CSVRequestHandlerTest, TestQueryUtils, TestRTimerTree, DirectSolrSpellCheckerTest, TestUpdate, TermVectorComponentTest, TimeZoneUtilsTest, TestNRTOpen, MBeansHandlerTest, TestEmbeddedSolrServerConstructors, TestSystemIdResolver, BasicFunctionalityTest, TestSolrDeletionPolicy2, TestSchemaVersionResource, SuggestComponentContextFilterQueryTest, ChaosMonkeySafeLeaderTest, TestSolrCoreProperties, TestSolrConfigHandler, CoreAdminCreateDiscoverTest, SpatialFilterTest, SchemaVersionSpecificBehaviorTest, DistributedMLTComponentTest, TestDocumentBuilder, DistributedFacetPivotWhiteBoxTest, SuggesterFSTTest, TestRandomRequestDistribution, ConvertedLegacyTest, ZkControllerTest, ZkCLITest, BigEndianAscendingWordDeserializerTest, HdfsCollectionsAPIDistributedZkTest, TestQuerySenderNoQuery, JavabinLoaderTest, TestSizeLimitedDistributedMap, TestIntervalFaceting, InfoHandlerTest, TestDFRSimilarityFactory, TestLFUCache, SimpleCollectionCreateDeleteTest, DistributedFacetPivotLongTailTest, TestSimpleTrackingShardHandler, CdcrReplicationHandlerTest, MinimalSchemaTest, TestRuleBasedAuthorizationPlugin, AsyncMigrateRouteKeyTest, TestImplicitCoreProperties, TestClassicSimilarityFactory, TestSimpleQParserPlugin, TestCursorMarkWithoutUniqueKey, ShardSplitTest, TestConfigSetsAPIExclusivity, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed [300/579 (3!)] on J1 in 538.35s, 1 test, 1 error <<< FAILURES!

[...truncated 958 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 3 errors, 31 ignored (16 assumptions) [seed: 1ABE324BFDA11B34]

Total time: 280 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-NightlyTests-6.0 - Build # 6 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.0/6/

5 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testAsyncRequests

Error Message:
Could not find a healthy node to handle the request.

Stack Trace:
org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
	at __randomizedtesting.SeedInfo.seed([EE656BC9F832E2A4:A21577E5E9AAC7B]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1094)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:953)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:953)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:953)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:953)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:953)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106)
	at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:71)
	at org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testAsyncRequests(CollectionsAPIAsyncDistributedZkTest.java:119)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
	at __randomizedtesting.SeedInfo.seed([EE656BC9F832E2A4:30EF05B4C3908057]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:174)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:130)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:850)
	at org.apache.solr.cloud.LeaderInitiatedRecoveryOnShardRestartTest.testRestartWithAllInLIR(LeaderInitiatedRecoveryOnShardRestartTest.java:158)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=34451, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=34451, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
	at __randomizedtesting.SeedInfo.seed([EE656BC9F832E2A4:6631541356CE8F5C]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37333/_jl: collection already exists: awholynewstresscollection_collection3_0
	at __randomizedtesting.SeedInfo.seed([EE656BC9F832E2A4]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 8 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 8 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([EE656BC9F832E2A4]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:248)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=17870, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17870, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:59405/sjz/xk, http://127.0.0.1:36147/sjz/xk, http://127.0.0.1:49679/sjz/xk, http://127.0.0.1:34909/sjz/xk, http://127.0.0.1:41771/sjz/xk]
	at __randomizedtesting.SeedInfo.seed([EE656BC9F832E2A4]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:983)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:59405/sjz/xk, http://127.0.0.1:36147/sjz/xk, http://127.0.0.1:49679/sjz/xk, http://127.0.0.1:34909/sjz/xk, http://127.0.0.1:41771/sjz/xk]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36147/sjz/xk: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 7 more




Build Log:
[...truncated 11394 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/init-core-data-001
   [junit4]   2> 574466 INFO  (SUITE-CollectionsAPIAsyncDistributedZkTest-seed#[EE656BC9F832E2A4]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 574466 INFO  (SUITE-CollectionsAPIAsyncDistributedZkTest-seed#[EE656BC9F832E2A4]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 574486 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 574486 INFO  (Thread-1915) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 574486 INFO  (Thread-1915) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 574590 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.ZkTestServer start zk server on port:51151
   [junit4]   2> 574590 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 574598 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 574622 INFO  (zkCallback-483-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2000a817 name:ZooKeeperConnection Watcher:127.0.0.1:51151 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 574622 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 574622 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 574622 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 574642 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 574654 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 574662 INFO  (zkCallback-484-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@214bbc35 name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 574662 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 574663 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 574663 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 574667 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 574667 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 574667 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 574668 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 574668 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 574669 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 574669 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 574670 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 574670 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 574671 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 574671 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 574671 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 574672 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 574672 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 574672 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 574673 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 574673 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 574674 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 574674 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 574674 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 574674 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 574679 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 574679 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 574680 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 574680 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 574681 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 574682 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 574686 INFO  (zkCallback-485-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70aa8297 name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 574686 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 574686 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 574879 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1
   [junit4]   2> 574939 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 574986 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72b2d118{/,null,AVAILABLE}
   [junit4]   2> 575004 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.u.s.SslContextFactory x509=X509@25cec2cb(solrtest,h=[],w=[]) for SslContextFactory@4110fd7b(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 575200 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.ServerConnector Started ServerConnector@48a218a1{SSL,[ssl, http/1.1]}{127.0.0.1:49129}
   [junit4]   2> 575200 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.Server Started @580673ms
   [junit4]   2> 575200 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/tempDir-001/control/data, hostContext=/, hostPort=49129, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores}
   [junit4]   2> 575200 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 575200 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001'
   [junit4]   2> 575221 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 575221 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 575221 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 575232 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 575234 INFO  (zkCallback-486-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@47561fe5 name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 575234 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 575235 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 575235 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 575235 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/solr.xml
   [junit4]   2> 575239 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores
   [junit4]   2> 575239 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.CoreContainer New CoreContainer 1939842807
   [junit4]   2> 575239 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001]
   [junit4]   2> 575239 WARN  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/lib
   [junit4]   2> 575240 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 575250 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 575255 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 575255 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 575255 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51151/solr
   [junit4]   2> 575255 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 575255 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 575256 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 575266 INFO  (zkCallback-489-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32752e06 name:ZooKeeperConnection Watcher:127.0.0.1:51151 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 575266 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 575267 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 575534 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 575538 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@460ecdb2 name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 575546 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 575547 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 575547 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 575548 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 575549 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 575550 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 575551 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 575551 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 575558 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 575559 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 575559 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 575560 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 575560 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 575561 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 575561 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 575562 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95673589694988293-127.0.0.1:49129_-n_0000000000
   [junit4]   2> 575562 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49129_
   [junit4]   2> 575562 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 575562 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer Overseer (id=95673589694988293-127.0.0.1:49129_-n_0000000000) starting
   [junit4]   2> 575563 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 575571 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 575574 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 575575 INFO  (OverseerCollectionConfigSetProcessor-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 575590 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49129_
   [junit4]   2> 575597 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 575598 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49129_
   [junit4]   2> 575618 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 575618 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 575634 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 575634 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 575638 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores
   [junit4]   2> 575639 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 575639 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1
   [junit4]   2> 575639 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 575659 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 575659 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 575661 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 575661 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [n:127.0.0.1:49129_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 575661 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 575661 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:49129",
   [junit4]   2>   "node_name":"127.0.0.1:49129_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 575663 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:49129",
   [junit4]   2>   "node_name":"127.0.0.1:49129_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 575666 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 575666 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 575667 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 576661 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 576661 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 576662 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 576662 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 576665 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 576665 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1'
   [junit4]   2> 576665 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 576665 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 576666 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 576674 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 576677 WARN  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 576678 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 576724 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 576740 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 577084 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 577092 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 577093 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 577158 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 577160 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 577167 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 577168 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 577173 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1
   [junit4]   2> 577173 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 577174 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 577174 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data/]
   [junit4]   2> 577174 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@68c6161b
   [junit4]   2> 577178 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data
   [junit4]   2> 577178 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data/index/
   [junit4]   2> 577178 WARN  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 577179 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data/index
   [junit4]   2> 577179 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=3, maxMergeAtOnceExplicit=7, maxMergedSegmentMB=2.16796875, floorSegmentMB=0.4150390625, forceMergeDeletesPctAllowed=3.029980953595426, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.887263938729532
   [junit4]   2> 577194 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@915d2ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d588fb0),segFN=segments_1,generation=1}
   [junit4]   2> 577194 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 577196 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 577196 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 577197 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 577197 WARN  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 577198 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data/
   [junit4]   2> 577198 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 577216 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 577217 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 577223 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 577224 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 577239 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 577239 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 577240 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 577240 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 577240 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 577240 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 577250 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 577254 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@915d2ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d588fb0),segFN=segments_1,generation=1}
   [junit4]   2> 577254 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 577254 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6896c083[collection1] main]
   [junit4]   2> 577254 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 577255 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 577255 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 577255 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 577255 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 577255 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 577256 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1530777438023319552
   [junit4]   2> 577258 INFO  (searcherExecutor-1214-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6896c083[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 577258 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1530777438023319552
   [junit4]   2> 577258 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 577259 INFO  (coreLoadExecutor-1213-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 577347 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 577350 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:49129 collection:control_collection shard:shard1
   [junit4]   2> 577351 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 577353 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95673589694988293-core_node1-n_0000000000
   [junit4]   2> 577353 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 577359 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 577359 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 577362 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 577362 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 577362 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:49129/collection1/
   [junit4]   2> 577362 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 577362 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:49129/collection1/ has no replicas
   [junit4]   2> 577370 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 577370 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 577378 INFO  (zkCallback-492-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@623d5e65 name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 577378 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 577378 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 577378 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 577379 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 577379 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 577379 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 577379 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 577387 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 577394 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95673589694988293-core_node1-n_0000000000
   [junit4]   2> 577402 INFO  (zkCallback-493-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a1f84cc name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 577402 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 577402 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 577402 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:49129/collection1/ shard1
   [junit4]   2> 577403 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:49129",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 577411 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 577411 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 577411 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 577411 INFO  (zkCallback-492-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 577460 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:49129/collection1/ and leader is https://127.0.0.1:49129/collection1/
   [junit4]   2> 577460 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:49129
   [junit4]   2> 577460 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 577460 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 577460 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 577461 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:49129",
   [junit4]   2>   "node_name":"127.0.0.1:49129_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 577462 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:49129",
   [junit4]   2>   "node_name":"127.0.0.1:49129_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 577462 INFO  (OverseerStateUpdate-95673589694988293-127.0.0.1:49129_-n_0000000000) [n:127.0.0.1:49129_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 577466 INFO  (coreZkRegister-1207-thread-1-processing-n:127.0.0.1:49129_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49129_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 577565 INFO  (zkCallback-490-thread-1-processing-n:127.0.0.1:49129_) [n:127.0.0.1:49129_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 577566 INFO  (zkCallback-492-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 577607 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/shard-1-001/cores/collection1
   [junit4]   2> 577608 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/shard-1-001
   [junit4]   2> 577609 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 577610 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43e35961{/,null,AVAILABLE}
   [junit4]   2> 577610 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.u.s.SslContextFactory x509=X509@7e124e3d(solrtest,h=[],w=[]) for SslContextFactory@30596e35(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 577619 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1257f81e{SSL,[ssl, http/1.1]}{127.0.0.1:43991}
   [junit4]   2> 577619 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.e.j.s.Server Started @583092ms
   [junit4]   2> 577619 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=43991, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/shard-1-001/cores}
   [junit4]   2> 577619 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 577619 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/shard-1-001'
   [junit4]   2> 577620 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 577620 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 577620 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 577639 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 577646 INFO  (zkCallback-494-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@36b1dd7b name:ZooKeeperConnection Watcher:127.0.0.1:51151/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 577646 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 577646 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 577648 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 577648 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/shard-1-001/solr.xml
   [junit4]   2> 577657 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIAsyncDistributedZkTest_EE656BC9F832E2A4-001/shard-1-001/cores
   [junit4]   2> 577657 INFO  (TEST-CollectionsAPIAsyncDistributedZkTest.testAsyncRequests-seed#[EE656BC9F832E2A4]) [    ] o.a.s.c.CoreConta

[...truncated too long message...]

8)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:52)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 54 more
   [junit4]   2> 6504710 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[EE656BC9F832E2A4]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Apr 05, 2016 3:10:54 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=PostingsFormat(name=Memory doPackFST= false), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=PostingsFormat(name=Memory doPackFST= false), multiDefault=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_t=PostingsFormat(name=Memory doPackFST= false), intDefault=PostingsFormat(name=Memory doPackFST= false), a_i1=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= false), text=PostingsFormat(name=Memory doPackFST= true), range_facet_l=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=Memory doPackFST= false)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene54), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=30, maxMBSortInHeap=5.947108748414875, sim=ClassicSimilarity, locale=sr-Latn-ME, timezone=SystemV/AST4ADT
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=125702176,total=523763712
   [junit4]   2> NOTE: All tests run in this JVM: [TestCursorMarkWithoutUniqueKey, SolrPluginUtilsTest, HdfsThreadLeakTest, AsyncMigrateRouteKeyTest, SpatialRPTFieldTypeTest, InfoHandlerTest, SimpleCollectionCreateDeleteTest, TestNoOpRegenerator, TestSQLHandler, UniqFieldsUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderTest, TestReplicationHandlerBackup, GraphQueryTest, TimeZoneUtilsTest, TestQuerySenderNoQuery, TestUpdate, HdfsDirectoryTest, TestDynamicFieldCollectionResource, MoreLikeThisHandlerTest, SoftAutoCommitTest, TestHashPartitioner, TestPartialUpdateDeduplication, TestDocBasedVersionConstraints, TermsComponentTest, TestSolrQueryResponse, WordBreakSolrSpellCheckerTest, TestBinaryResponseWriter, SpellCheckCollatorTest, TestManagedResourceStorage, IndexBasedSpellCheckerTest, TestSchemaNameResource, TestMiniSolrCloudClusterBase, ConjunctionSolrSpellCheckerTest, DeleteInactiveReplicaTest, SuggestComponentContextFilterQueryTest, SpatialFilterTest, TestDistributedGrouping, TestBM25SimilarityFactory, CollectionsAPIAsyncDistributedZkTest, TestManagedSynonymFilterFactory, ShardSplitTest, TestLMJelinekMercerSimilarityFactory, TestStressVersions, TestCodecSupport, SortSpecParsingTest, TestImplicitCoreProperties, TestConfigSetProperties, NotRequiredUniqueKeyTest, CoreAdminCreateDiscoverTest, TestSolrQueryParserResource, TestDefaultStatsCache, TestSchemaVersionResource, ZkControllerTest, SortByFunctionTest, DistributedTermsComponentTest, ClusterStateUpdateTest, CheckHdfsIndexTest, QueryResultKeyTest, DocValuesTest, BasicFunctionalityTest, DistributedIntervalFacetingTest, TestRTimerTree, TestRequestForwarding, DistributedVersionInfoTest, JavabinLoaderTest, TestOrdValues, TestXmlQParser, TestExactStatsCache, DistributedFacetPivotWhiteBoxTest, TriLevelCompositeIdRoutingTest, TestNRTOpen, ZkStateReaderTest, TestWordDelimiterFilterFactory, CSVRequestHandlerTest, DistributedMLTComponentTest, DistributedFacetPivotLongTailTest, PKIAuthenticationIntegrationTest, SpellingQueryConverterTest, TestRuleBasedAuthorizationPlugin, HighlighterTest, TestExpandComponent, TestManagedSchema, DistanceFunctionTest, TestFastLRUCache, TestRecoveryHdfs, SolrInfoMBeanTest, HLLUtilTest, BlockJoinFacetDistribTest, TestSolrDeletionPolicy2, CloneFieldUpdateProcessorFactoryTest, FileUtilsTest, DirectSolrSpellCheckerTest, BasicDistributedZkTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler, CloudExitableDirectoryReaderTest, CollectionReloadTest, ConcurrentDeleteAndCreateCollectionTest, CustomCollectionTest, DistribDocExpirationUpdateProcessorTest, DistributedQueueTest, ForceLeaderTest, MigrateRouteKeyTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, OverseerStatusTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, RemoteQueryErrorTest, ReplicationFactorTest, RestartWhileUpdatingTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCloudExampleTest, TestAuthenticationFramework, TestCollectionAPI, TestDistribDocBasedVersion, TestExclusionRuleCollectionAccess, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestRequestStatusCollectionAPI, TestSizeLimitedDistributedMap, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [482/579 (5!)] on J1 in 621.67s, 1 test, 1 error <<< FAILURES!

[...truncated 334 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/solr/common-build.xml:527: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.0/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 1 suite-level error, 3 errors, 1 failure, 31 ignored (16 assumptions) [seed: EE656BC9F832E2A4]

Total time: 311 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any