You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/19 14:39:08 UTC

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_51) - Build # 3875 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3875/
Java: 32bit/jdk1.7.0_51 -server -XX:+UseConcMarkSweepGC

11 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.CursorPagingTest

Error Message:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms

Stack Trace:
java.lang.RuntimeException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:142)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:147)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:98)
	at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:564)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:556)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:365)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:352)
	at org.apache.solr.CursorPagingTest.beforeTests(CursorPagingTest.java:63)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:766)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:137)
	... 29 more
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
	... 37 more


REGRESSION:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch

Error Message:


Stack Trace:
org.apache.solr.common.cloud.ZooKeeperException: 
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:8954838857DCA7C3]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:249)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.initCloud(AbstractFullDistribZkTestBase.java:256)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:312)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /live_nodes
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
	at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:299)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:242)
	... 42 more


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest

Error Message:
ERROR: SolrZkClient opens=4 closes=3

Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=4 closes=3
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:435)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
	at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:789)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest:     1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)    2) Thread[id=2298, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-EventThread, state=WAITING, group=TGRP-FullSolrCloudDistribCmdsTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest: 
   1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   2) Thread[id=2298, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-EventThread, state=WAITING, group=TGRP-FullSolrCloudDistribCmdsTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)         at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)         at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)         at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
        at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)


REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testDiscovery

Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms

Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D52D7254C9C9A86]:0)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
	at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
	at org.apache.solr.core.TestCoreDiscovery.testDiscovery(TestCoreDiscovery.java:137)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
	... 48 more


REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testNoCoreDir

Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms

Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D32FFE8D15629B5B]:0)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
	at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
	at org.apache.solr.core.TestCoreDiscovery.testNoCoreDir(TestCoreDiscovery.java:233)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
	... 48 more


REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testDuplicateNames

Error Message:
Wrong exception thrown on duplicate core names

Stack Trace:
java.lang.AssertionError: Wrong exception thrown on duplicate core names
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:F3C2BDA47F4F337A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.core.TestCoreDiscovery.testDuplicateNames(TestCoreDiscovery.java:186)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testAlternateCoreDir

Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms

Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:CDA9B614D93E2DAF]:0)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
	at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
	at org.apache.solr.core.TestCoreDiscovery.testAlternateCoreDir(TestCoreDiscovery.java:210)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
	... 48 more


FAILED:  junit.framework.TestSuite.org.apache.solr.request.TestFaceting

Error Message:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms

Stack Trace:
java.lang.RuntimeException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:142)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:147)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:98)
	at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:564)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:556)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:365)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:352)
	at org.apache.solr.request.TestFaceting.beforeClass(TestFaceting.java:43)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:766)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:137)
	... 29 more
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
	... 37 more


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.DocValuesMissingTest

Error Message:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms

Stack Trace:
java.lang.RuntimeException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:142)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:147)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:98)
	at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:564)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:556)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:365)
	at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:352)
	at org.apache.solr.schema.DocValuesMissingTest.beforeClass(DocValuesMissingTest.java:32)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:766)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
	at org.apache.solr.util.TestHarness.<init>(TestHarness.java:137)
	... 29 more
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
	... 37 more




Build Log:
[...truncated 10255 lines...]
   [junit4] Suite: org.apache.solr.core.TestCoreDiscovery
   [junit4]   2> 827253 T2252 oas.SolrTestCaseJ4.startTrackingSearchers WARN startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 827254 T2252 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 827254 T2252 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestCoreDiscovery-1395236002225
   [junit4]   2> 827256 T2252 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 827260 T2252 oas.SolrTestCaseJ4.setUp ###Starting testDiscovery
   [junit4]   2> 827319 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 827319 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
   [junit4]   2> 827320 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
   [junit4]   2> 827361 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
   [junit4]   2> 827475 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
   [junit4]   2> 827476 T2252 oasc.CoreContainer.<init> New CoreContainer 18029925
   [junit4]   2> 827476 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
   [junit4]   2> 827480 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 827481 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 827481 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 827481 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 827498 T2252 oasc.SolrCores.allocateLazyCores Allocating transient cache for 2 transient cores
   [junit4]   2> 827505 T2252 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 827505 T2252 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 827505 T2252 oasc.CoreContainer.load Host Name: 222.333.444.555
   [junit4]   2> 827505 T2252 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58059/solr
   [junit4]   2> 827505 T2252 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 827510 T2252 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 828467 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 830499 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 832529 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 834624 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 836856 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 839080 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 841313 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 843545 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 845904 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 848360 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 850817 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 853274 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 855728 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 858369 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 861246 T2252 oas.SolrTestCaseJ4.tearDown ###Ending testDiscovery
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.method=testDiscovery -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   34.0s | TestCoreDiscovery.testDiscovery <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D52D7254C9C9A86]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
   [junit4]    > 	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
   [junit4]    > 	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
   [junit4]    > 	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
   [junit4]    > 	at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
   [junit4]    > 	at org.apache.solr.core.TestCoreDiscovery.testDiscovery(TestCoreDiscovery.java:137)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]    > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
   [junit4]    > 	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
   [junit4]    > 	... 48 more
   [junit4]   2> 861265 T2252 oas.SolrTestCaseJ4.setUp ###Starting testNoCoreDir
   [junit4]   2> 861298 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 861298 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
   [junit4]   2> 861298 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
   [junit4]   2> 861339 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
   [junit4]   2> 861399 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=18029925
   [junit4]   2> 861459 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\noCoreDir
   [junit4]   2> 861459 T2252 oasc.CoreContainer.<init> New CoreContainer 9262736
   [junit4]   2> 861460 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
   [junit4]   2> 861461 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 861463 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 861463 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 861463 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 861465 T2252 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 861479 T2252 oasc.SolrCores.allocateLazyCores Allocating transient cache for 2 transient cores
   [junit4]   2> 861480 T2252 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 861482 T2252 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 861482 T2252 oasc.CoreContainer.load Host Name: 222.333.444.555
   [junit4]   2> 861482 T2252 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58059/solr
   [junit4]   2> 861483 T2252 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 861485 T2252 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 862774 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 865479 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 868179 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 871075 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 874046 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 877019 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 880007 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 882978 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 886134 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 889289 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 892428 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 895551 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 898655 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 901507 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 904488 T2252 oas.SolrTestCaseJ4.tearDown ###Ending testNoCoreDir
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.method=testNoCoreDir -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   43.2s | TestCoreDiscovery.testNoCoreDir <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D32FFE8D15629B5B]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
   [junit4]    > 	at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
   [junit4]    > 	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
   [junit4]    > 	at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
   [junit4]    > 	at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
   [junit4]    > 	at org.apache.solr.core.TestCoreDiscovery.testNoCoreDir(TestCoreDiscovery.java:233)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]    > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
   [junit4]    > 	at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
   [junit4]    > 	... 48 more
   [junit4]   2> 904505 T2252 oas.SolrTestCaseJ4.setUp ###Starting testDuplicateNames
   [junit4]   2> 904559 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 904561 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
   [junit4]   2> 904561 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
   [junit4]   2> 904623 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
   [junit4]   2> 904741 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
   [junit4]   2> 904741 T2252 oasc.CoreContainer.<init> New CoreContainer 31126436
   [junit4]   2> 904743 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
   [junit4]   2> 904745 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 904745 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 904745 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 904746 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 904746 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 904746 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 904748 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 904748 T2252 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 904748 T2252 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 904761 T2252 oasc.SolrCores.allocateLazyCores Allocating transient cache for 2 transient cores
   [junit4]   2> 904762 T2252 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 904762 T2252 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 904762 T2252 oasc.CoreContainer.load Host Name: 222.333.444.555
   [junit4]   2> 904764 T2252 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58059/solr
   [junit4]   2> 904764 T2252 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 904766 T2252 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 906120 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 908947 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 911777 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 914345 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 916900 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 919456 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 922005 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 924490 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 926789 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 929087 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 931388 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 933676 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 935858 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 937927 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> 940125 T2252 oas.SolrTestCaseJ4.tearDown ###Ending testDuplicateNames
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.method=testDuplicateNames -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 35.6s | TestCoreDiscovery.testDuplicateNames <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Wrong exception thrown on duplicate core names
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:F3C2BDA47F4F337A]:0)
   [junit4]    > 	at org.apache.solr.core.TestCoreDiscovery.testDuplicateNames(TestCoreDiscovery.java:186)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 940138 T2252 oas.SolrTestCaseJ4.setUp ###Starting testAlternateCoreDir
   [junit4]   2> 940179 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 940179 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
   [junit4]   2> 940179 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
   [junit4]   2> 940211 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
   [junit4]   2> 940257 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=31126436
   [junit4]   2> 940258 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=9262736
   [junit4]   2> 940321 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\alternateCoreDir
   [junit4]   2> 940322 T2252 oasc.CoreContainer.<init> New CoreContainer 21706393
   [junit4]   2> 940322 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
   [junit4]   2> 940324 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 940324 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 940324 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 940325 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 940325 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]  

[...truncated too long message...]

adLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
   [junit4]   2> 	   1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 1072365 T2297 oaz.ClientCnxn$SendThread.run WARN Session 0x144da8f206e0003 for server null, unexpected error, closing socket connection and attempting reconnect java.nio.channels.ClosedByInterruptException
   [junit4]   2> 	at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:775)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=11), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=11)), sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=iw, timezone=GB-Eire
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_51 (32-bit)/cpus=2,threads=2,free=74795528,total=231591936
   [junit4]   2> NOTE: All tests run in this JVM: [SpellCheckCollatorTest, CacheHeaderTest, TestSchemaSimilarityResource, PreAnalyzedFieldTest, FastVectorHighlighterTest, DistributedQueryComponentOptimizationTest, PeerSyncTest, NotRequiredUniqueKeyTest, SolrCoreTest, TestFastLRUCache, ScriptEngineTest, TestManagedResourceStorage, StandardRequestHandlerTest, TestBadConfig, DeleteInactiveReplicaTest, TestCharFilters, SuggesterTSTTest, TestSolrDeletionPolicy2, SliceStateTest, FieldAnalysisRequestHandlerTest, RAMDirectoryFactoryTest, IndexSchemaTest, TestHashPartitioner, ClusterStateUpdateTest, SchemaVersionSpecificBehaviorTest, TestSearchPerf, TestDFRSimilarityFactory, DistributedSpellCheckComponentTest, SyncSliceTest, TestCustomSort, ShardRoutingCustomTest, TestLRUCache, ConvertedLegacyTest, StressHdfsTest, TestIBSimilarityFactory, TestLMJelinekMercerSimilarityFactory, HighlighterConfigTest, DirectUpdateHandlerOptimizeTest, TestMultiCoreConfBootstrap, TestDistributedSearch, ZkCLITest, TestFieldSortValues, TestJoin, TestSolrJ, BadComponentTest, HdfsLockFactoryTest, SpellPossibilityIteratorTest, TestRealTimeGet, TestReload, SolrIndexSplitterTest, RangeFacetTest, TestArbitraryIndexDir, URLClassifyProcessorTest, ResourceLoaderTest, TestRTGBase, LeaderElectionTest, ModifyConfFileTest, TestInfoStreamLogging, ExternalFileFieldSortTest, ConnectionManagerTest, TestSolrCoreProperties, XmlUpdateRequestHandlerTest, OutputWriterTest, DocValuesMultiTest, CSVRequestHandlerTest, TestWriterPerf, DistributedTermsComponentTest, TestCloudManagedSchemaAddField, HardAutoCommitTest, ParsingFieldUpdateProcessorsTest, RemoteQueryErrorTest, TestNRTOpen, SolrRequestParserTest, UpdateRequestProcessorFactoryTest, DistributedDebugComponentTest, TermVectorComponentTest, CurrencyFieldOpenExchangeTest, TestSweetSpotSimilarityFactory, ExpressionTest, AddBlockUpdateTest, SortByFunctionTest, TestCoreDiscovery, TestFaceting, DocValuesMissingTest, SpellingQueryConverterTest, CursorPagingTest, FullSolrCloudDistribCmdsTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=iw -Dtests.timezone=GB-Eire -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s | FullSolrCloudDistribCmdsTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=4 closes=3
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:435)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest: 
   [junit4]    >    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]    >    2) Thread[id=2298, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-EventThread, state=WAITING, group=TGRP-FullSolrCloudDistribCmdsTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
   [junit4]    >         at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
   [junit4]    >         at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
   [junit4] Completed in 30.45s, 1 test, 1 failure, 3 errors <<< FAILURES!

[...truncated 920 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 391 suites, 1573 tests, 6 suite-level errors, 4 errors, 1 failure, 1232 ignored (22 assumptions)

Total time: 47 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0) - Build # 3877 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3877/
Java: 32bit/jdk1.8.0 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  TEST-org.apache.solr.schema.TestCloudManagedSchema.xml.<init>

Error Message:


Stack Trace:
Failed to read test report file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\TEST-org.apache.solr.schema.TestCloudManagedSchema.xml
org.dom4j.DocumentException: Error on line 5 of document file:///C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/TEST-org.apache.solr.schema.TestCloudManagedSchema.xml : XML document structures must start and end within the same entity. Nested exception: XML document structures must start and end within the same entity.
	at org.dom4j.io.SAXReader.read(SAXReader.java:482)
	at org.dom4j.io.SAXReader.read(SAXReader.java:264)
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:123)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:273)
	at hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:229)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:164)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:147)
	at hudson.tasks.junit.TestResult.<init>(TestResult.java:123)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:117)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:90)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2462)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:328)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)
Caused by: org.xml.sax.SAXParseException; systemId: file:///C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/TEST-org.apache.solr.schema.TestCloudManagedSchema.xml; lineNumber: 5; columnNumber: 53; XML document structures must start and end within the same entity.
	at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source)
	at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.endEntity(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.endEntity(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.endEntity(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.load(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.peekChar(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
	at org.dom4j.io.SAXReader.read(SAXReader.java:465)
	... 18 more
Nested exception: 
org.xml.sax.SAXParseException; systemId: file:///C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/TEST-org.apache.solr.schema.TestCloudManagedSchema.xml; lineNumber: 5; columnNumber: 53; XML document structures must start and end within the same entity.
	at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source)
	at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.endEntity(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.endEntity(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityManager.endEntity(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.load(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.peekChar(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(Unknown Source)
	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source)
	at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source)
	at org.dom4j.io.SAXReader.read(SAXReader.java:465)
	at org.dom4j.io.SAXReader.read(SAXReader.java:264)
	at hudson.tasks.junit.SuiteResult.parse(SuiteResult.java:123)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:273)
	at hudson.tasks.junit.TestResult.parsePossiblyEmpty(TestResult.java:229)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:164)
	at hudson.tasks.junit.TestResult.parse(TestResult.java:147)
	at hudson.tasks.junit.TestResult.<init>(TestResult.java:123)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:117)
	at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:90)
	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2462)
	at hudson.remoting.UserRequest.perform(UserRequest.java:118)
	at hudson.remoting.UserRequest.perform(UserRequest.java:48)
	at hudson.remoting.Request$2.run(Request.java:328)
	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
	at java.util.concurrent.FutureTask.run(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Unknown Source)




Build Log:
[...truncated 11201 lines...]
   [junit4] Suite: org.apache.solr.schema.TestCloudManagedSchema
   [junit4]   2> 2859808 T11889 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 2859808 T11889 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2859812 T11889 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestCloudManagedSchema-1395286763411
   [junit4]   2> 2859815 T11889 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2859816 T11890 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2859916 T11889 oasc.ZkTestServer.run start zk server on port:51365
   [junit4]   2> 2859918 T11889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2859928 T11896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15921d4 name:ZooKeeperConnection Watcher:127.0.0.1:51365 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2859928 T11889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2859928 T11889 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2859933 T11891 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dd92679b0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2859934 T11889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2859939 T11898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c6d177 name:ZooKeeperConnection Watcher:127.0.0.1:51365/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2859939 T11889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2859939 T11889 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2859944 T11889 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2859947 T11889 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2859950 T11889 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2859954 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-managed-schema.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2859954 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2859960 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2859961 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2859966 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2859967 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2859971 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2859971 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2859975 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2859976 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2859979 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2859980 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2859984 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2859985 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2859988 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2859989 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2859993 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2859994 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2859996 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2859997 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2860000 T11889 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2860001 T11889 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2860006 T11891 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dd92679b0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2860007 T11889 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2860009 T11900 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11ab557 name:ZooKeeperConnection Watcher:127.0.0.1:51365/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2860010 T11889 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2860013 T11891 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dd92679b0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.schema.TestCloudManagedSchema-1395286763409\zookeeper\server1\data\version-2\log.1 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.schema.TestCloudManagedSchema-1395286763409\zookeeper\server1\data\version-2 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.schema.TestCloudManagedSchema-1395286763409\zookeeper\server1\data FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.schema.TestCloudManagedSchema-1395286763409\zookeeper\server1 FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.schema.TestCloudManagedSchema-1395286763409\zookeeper FAILED !!!!!
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.schema.TestCloudManagedSchema-1395286763409 FAILED !!!!!
   [junit4]   2> 2860935 T11889 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 2860939 T11889 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51365 51365
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCloudManagedSchema -Dtests.method=testDistribSearch -Dtests.seed=C1B6A2EA2F6109A8 -Dtests.slow=true -Dtests.locale=ar_KW -Dtests.timezone=America/Indiana/Vevay -Dtests.file.encoding=UTF-8
   [junit4] ERROR   3.39s | TestCloudManagedSchema.testDistribSearch <<<
   [junit4]    > Throwable #1: java.io.IOException: There is not enough space on the disk
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C1B6A2EA2F6109A8:40502CF2583E6994]:0)
   [junit4]    > 	at sun.nio.ch.FileDispatcherImpl.pwrite0(Native Method)
   [junit4]    > 	at sun.nio.ch.FileDispatcherImpl.pwrite(FileDispatcherImpl.java:80)
   [junit4]    > 	at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
   [junit4]    > 	at sun.nio.ch.IOUtil.write(IOUtil.java:51)
   [junit4]    > 	at sun.nio.ch.FileChannelImpl.writeInternal(FileChannelImpl.java:730)
   [junit4]    > 	at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:713)
   [junit4]    > 	at sun.nio.ch.FileChannelImpl.transferFromFileChannel(FileChannelImpl.java:588)
   [junit4]    > 	at sun.nio.ch.FileChannelImpl.transferFrom(FileChannelImpl.java:660)
   [junit4]    > 	at org.apache.commons.io.FileUtils.doCopyFile(FileUtils.java:944)
   [junit4]    > 	at org.apache.commons.io.FileUtils.doCopyDirectory(FileUtils.java:1225)
   [junit4]    > 	at org.apache.commons.io.FileUtils.doCopyDirectory(FileUtils.java:1223)
   [junit4]    > 	at org.apache.commons.io.FileUtils.doCopyDirectory(FileUtils.java:1223)
   [junit4]    > 	at org.apache.commons.io.FileUtils.doCopyDirectory(FileUtils.java:1223)
   [junit4]    > 	at org.apache.commons.io.FileUtils.doCopyDirectory(FileUtils.java:1223)
   [junit4]    > 	at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1186)
   [junit4]    > 	at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1058)
   [junit4]    > 	at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1027)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.setupJettySolrHome(BaseDistributedSearchTestCase.java:931)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:289)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 2863202 T11889 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=ar_KW, timezone=America/Indiana/Vevay
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=1,free=158558256,total=396636160
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolr4Spatial, LeaderElectionIntegrationTest, TestManagedResourceStorage, DistributedSpellCheckComponentTest, TestSerializedLuceneMatchVersion, FullSolrCloudDistribCmdsTest, AddBlockUpdateTest, TestDynamicFieldCollectionResource, OverseerRolesTest, TestRealTimeGet, TestStressUserVersions, SliceStateUpdateTest, BasicZkTest, TestCustomSort, ShardRoutingTest, HdfsWriteToMultipleCollectionsTest, PluginInfoTest, TestSimpleQParserPlugin, TestCollationField, MBeansHandlerTest, MigrateRouteKeyTest, SearchHandlerTest, TestRecoveryHdfs, TestQueryUtils, TestSurroundQueryParser, RegexBoostProcessorTest, CursorMarkTest, HdfsCollectionsAPIDistributedZkTest, URLClassifyProcessorTest, CoreContainerCoreInitFailuresTest, TestIBSimilarityFactory, TermVectorComponentDistributedTest, FileUtilsTest, TestWriterPerf, CollectionsAPIDistributedZkTest, TestSolrIndexConfig, DeleteInactiveReplicaTest, ConvertedLegacyTest, ClusterStateTest, MoreLikeThisHandlerTest, TestRestManager, TestUniqueKeyFieldResource, StatsComponentTest, TestReload, TestFieldSortValues, QueryEqualityTest, TestFieldTypeResource, StandardRequestHandlerTest, CoreAdminHandlerTest, OutputWriterTest, SpellCheckCollatorTest, RequestHandlersTest, TestInfoStreamLogging, TestValueSourceCache, HdfsBasicDistributedZk2Test, AliasIntegrationTest, TestFreeTextSuggestions, HighlighterConfigTest, TestModifyConfFiles, TestDefaultSearchFieldResource, TestIndexSearcher, TestJoin, RequiredFieldsTest, DirectSolrConnectionTest, IndexBasedSpellCheckerTest, TestStressReorder, TestDistributedGrouping, DocumentBuilderTest, ResponseLogComponentTest, AddSchemaFieldsUpdateProcessorFactoryTest, OpenCloseCoreStressTest, DisMaxRequestHandlerTest, TestBM25SimilarityFactory, BasicDistributedZk2Test, SolrCoreCheckLockOnStartupTest, TestSearchPerf, ExpressionTest, ChaosMonkeySafeLeaderTest, TestQuerySenderNoQuery, DistributedQueryComponentOptimizationTest, SuggesterTSTTest, MinimalSchemaTest, TestDistributedMissingSort, SortByFunctionTest, SampleTest, TestXIncludeConfig, SliceStateTest, CircularListTest, TestBadConfig, SolrRequestParserTest, TestNonNRTOpen, TestFunctionQuery, SpellCheckComponentTest, TestUpdate, BasicFunctionalityTest, TestIndexingPerformance, LoggingHandlerTest, TestExpandComponent, DistributedQueryComponentCustomSortTest, TestOverriddenPrefixQueryForCustomFieldType, TestDocumentBuilder, TestOmitPositions, UnloadDistributedZkTest, MultiTermTest, ZkSolrClientTest, PrimUtilsTest, DistributedExpandComponentTest, RemoteQueryErrorTest, TestReversedWildcardFilterFactory, BlockDirectoryTest, TestPerFieldSimilarity, TestAtomicUpdateErrorCases, PingRequestHandlerTest, DocValuesMissingTest, TestMergePolicyConfig, CollectionsAPIAsyncDistributedZkTest, TestComponentsName, TestCopyFieldCollectionResource, LeaderElectionTest, PreAnalyzedUpdateProcessorTest, TestFileDictionaryLookup, PreAnalyzedFieldTest, TestInitQParser, TestQueryTypes, DeleteShardTest, JsonLoaderTest, ZkCLITest, TestGroupingSearch, TestShortCircuitedRequests, TestLRUCache, SpellingQueryConverterTest, HdfsRecoveryZkTest, SOLR749Test, RecoveryZkTest, TestRemoteStreaming, TestRecovery, XmlUpdateRequestHandlerTest, TestSolrJ, CustomCollectionTest, StressHdfsTest, AutoCommitTest, TestFastWriter, TestFieldResource, NoCacheHeaderTest, TestComplexPhraseQParserPlugin, BJQParserTest, IndexSchemaTest, QueryParsingTest, TermsComponentTest, ShowFileRequestHandlerTest, TestFastOutputStream, CoreAdminRequestStatusTest, PolyFieldTest, TestSolrDeletionPolicy1, TestPartialUpdateDeduplication, SolrTestCaseJ4Test, TestLMDirichletSimilarityFactory, QueryResultKeyTest, HdfsUnloadDistributedZkTest, ReturnFieldsTest, BlockCacheTest, AsyncMigrateRouteKeyTest, TestReloadAndDeleteDocs, DateMathParserTest, TestDistribDocBasedVersion, TestStressVersions, TestShardHandlerFactory, ChangedSchemaMergeTest, TestNonDefinedSimilarityFactory, DistributedDebugComponentTest, TestExceedMaxTermLength, ResourceLoaderTest, TestAddFieldRealTimeGet, TestLMJelinekMercerSimilarityFactory, TestFoldingMultitermQuery, TestMultiCoreConfBootstrap, CoreAdminCreateDiscoverTest, TestPhraseSuggestions, TestRandomDVFaceting, TriLevelCompositeIdRoutingTest, FileBasedSpellCheckerTest, TermVectorComponentTest, LukeRequestHandlerTest, TestBinaryField, BinaryUpdateRequestHandlerTest, TestSolrXMLSerializer, AnalysisErrorHandlingTest, TestCloudManagedSchemaAddField, TestQuerySenderListener, TestFieldTypeCollectionResource, BasicDistributedZkTest, SyncSliceTest, OverseerTest, TestReplicationHandler, ClusterStateUpdateTest, TestRandomFaceting, TestZkChroot, ShardRoutingCustomTest, TestDistributedSearch, TestFaceting, TestHashPartitioner, ZkControllerTest, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, TestSort, TestFiltering, TestLazyCores, DirectUpdateHandlerTest, OverseerCollectionProcessorTest, HighlighterTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, DocValuesTest, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, JSONWriterTest, TestCSVResponseWriter, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestBinaryResponseWriter, TestLFUCache, UpdateParamsTest, AlternateDirectoryTest, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestStressRecovery, TestSolrDeletionPolicy2, TestDocSet, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestNumberUtils, TestDefaultSimilarityFactory, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, RAMDirectoryFactoryTest, TestUtils, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, TestRTGBase, CursorPagingTest, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, AbstractAnalyticsStatsTest, NoFacetTest, AbstractAnalyticsFacetTest, FieldFacetExtrasTest, QueryFacetTest, RangeFacetTest, FunctionTest, AssignTest, ConnectionManagerTest, DeleteReplicaTest, DistribCursorPagingTest, SSLMigrationTest, ShardSplitTest, SolrXmlInZkTest, TestRequestStatusCollectionAPI, HdfsBasicDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, HdfsSyncSliceTest, CachingDirectoryFactoryTest, TestImplicitCoreProperties, TestNRTOpen, TestSolrXml, TestSolrXmlPersistence, TestSolrXmlPersistor, CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, DistributedSuggestComponentTest, SuggestComponentTest, TestManagedResource, TestClassNameShortening, TestDynamicFieldResource, TestFieldCollectionResource, TestManagedSchemaFieldResource, TestSchemaNameResource, TestSchemaResource, TestSchemaSimilarityResource, TestSchemaVersionResource, TestSolrQueryParserDefaultOperatorResource, TestSolrQueryParserResource, TestManagedStopFilterFactory, BadCopyFieldTest, EnumFieldTest, ModifyConfFileTest, TestCloudManagedSchema]
   [junit4] Completed in 3.43s, 1 test, 1 error <<< FAILURES!

[...truncated 2 lines...]
   [junit4] JVM J0: stderr was not empty, see: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\temp\junit4-J0-20140320_025140_500.syserr
   [junit4] >>> JVM J0: stderr (verbatim) ----
   [junit4] WARN: Exception at main loop level. -> java.lang.RuntimeException: java.io.IOException: There is not enough space on the disk
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.StdInLineIterator.computeNext(StdInLineIterator.java:34)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.StdInLineIterator.computeNext(StdInLineIterator.java:13)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.common.collect.Iterators$5.hasNext(Iterators.java:542)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:169)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:276)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12)
   [junit4] Caused by: java.io.IOException: There is not enough space on the disk
   [junit4] 	at java.io.RandomAccessFile.writeBytes(Native Method)
   [junit4] 	at java.io.RandomAccessFile.write(RandomAccessFile.java:493)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.RandomAccessFileOutputStream.write(RandomAccessFileOutputStream.java:28)
   [junit4] 	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
   [junit4] 	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
   [junit4] 	at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:297)
   [junit4] 	at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4] 	at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.Serializer.flush(Serializer.java:82)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.StdInLineIterator.computeNext(StdInLineIterator.java:29)
   [junit4] 	... 7 more
   [junit4] 
   [junit4] WARN: Exception closing serializer. -> java.io.IOException: There is not enough space on the disk
   [junit4] 	at java.io.RandomAccessFile.writeBytes(Native Method)
   [junit4] 	at java.io.RandomAccessFile.write(RandomAccessFile.java:493)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.RandomAccessFileOutputStream.write(RandomAccessFileOutputStream.java:28)
   [junit4] 	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
   [junit4] 	at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
   [junit4] 	at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
   [junit4] 	at sun.nio.cs.StreamEncoder.implClose(StreamEncoder.java:320)
   [junit4] 	at sun.nio.cs.StreamEncoder.close(StreamEncoder.java:149)
   [junit4] 	at java.io.OutputStreamWriter.close(OutputStreamWriter.java:233)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.events.Serializer.close(Serializer.java:94)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:298)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12)
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] ERROR: JVM J0 ended with an exception, command line: C:\Users\JenkinsSlave\tools\java\32bit\jdk1.8.0\jre\bin\java.exe -server -XX:+UseConcMarkSweepGC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\heapdumps -Dtests.prefix=tests -Dtests.seed=C1B6A2EA2F6109A8 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=5.0 -Dtests.cleanthreads=perClass -Djava.util.logging.config.file=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\tools\junit4\logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.slow=true -Dtests.asserts.gracious=false -Dtests.multiplier=1 -DtempDir=. -Djava.io.tmpdir=. -Djunit4.tempDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\temp -Dclover.db.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\clover\db -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Djava.security.policy=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\tools\junit4\tests.policy -Dlucene.version=5.0-SNAPSHOT -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.filterstacks=true -Dtests.disableHdfs=true -Dfile.encoding=UTF-8 -classpath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\classes\test;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-test-framework\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\test-framework\lib\junit4-ant-2.1.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\test-framework\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\codecs\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\common\lucene-analyzers-common-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\kuromoji\lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\analysis\phonetic\lucene-analyzers-phonetic-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\codecs\lucene-codecs-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\highlighter\lucene-highlighter-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\memory\lucene-memory-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\misc\lucene-misc-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\spatial\lucene-spatial-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\expressions\lucene-expressions-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\suggest\lucene-suggest-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\grouping\lucene-grouping-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queries\lucene-queries-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\queryparser\lucene-queryparser-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\join\lucene-join-5.0-SNAPSHOT.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\antlr-runtime-3.5.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\asm-4.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\asm-commons-4.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-cli-1.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-codec-1.9.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-configuration-1.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-fileupload-1.2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\commons-lang-2.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\concurrentlinkedhashmap-lru-1.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\dom4j-1.6.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\guava-14.0.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\hadoop-annotations-2.2.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\hadoop-auth-2.2.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\hadoop-common-2.2.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\hadoop-hdfs-2.2.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\hppc-0.5.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\joda-time-2.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\org.restlet-2.1.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\org.restlet.ext.servlet-2.1.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\protobuf-java-2.5.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\lib\spatial4j-0.4.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\commons-io-2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpclient-4.3.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpcore-4.3.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\httpmime-4.3.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\jcl-over-slf4j-1.7.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\jul-to-slf4j-1.7.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\log4j-1.2.16.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\noggit-0.5.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\slf4j-api-1.7.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\slf4j-log4j12-1.7.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\wstx-asl-3.2.7.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\lib\zookeeper-3.4.6.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-continuation-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-deploy-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-http-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-io-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-jmx-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-security-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-server-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-servlet-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-util-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-webapp-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\jetty-xml-8.1.10.v20130312.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\lib\servlet-api-3.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\example-DIH\solr\db\lib\derby-10.9.1.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\example-DIH\solr\db\lib\hsqldb-1.8.0.10.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\build\core\classes\java;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\test-framework\lib\junit-4.10.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\test-framework\lib\randomizedtesting-runner-2.1.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\antlr-runtime-3.5.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\asm-4.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\asm-commons-4.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\cglib-nodep-2.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\commons-collections-3.2.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\dom4j-1.6.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\easymock-3.0.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\hadoop-common-2.2.0-tests.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\hadoop-hdfs-2.2.0-tests.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\hppc-0.5.2.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\javax.servlet-api-3.0.1.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\jersey-core-1.8.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\jetty-6.1.26.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\jetty-util-6.1.26.jar;C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\test-lib\objenesis-1.2.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-launcher.jar;C:\Users\JenkinsSlave\.ant\lib\ivy-2.3.0.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-antlr.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-bcel.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-bsf.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-log4j.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-oro.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-regexp.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-resolver.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-apache-xalan2.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-commons-logging.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-commons-net.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jai.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-javamail.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jdepend.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jmf.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-jsch.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-junit.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-junit4.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-netrexx.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-swing.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant-testutil.jar;C:\Users\JenkinsSlave\tools\hudson.tasks.Ant_AntInstallation\ANT_1.8.2\lib\ant.jar;C:\Users\JenkinsSlave\tools\java\32bit\jdk1.8.0\lib\tools.jar;C:\Users\JenkinsSlave\.ivy2\cache\com.carrotsearch.randomizedtesting\junit4-ant\jars\junit4-ant-2.1.1.jar -ea:org.apache.lucene... -ea:org.apache.solr... com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -flush -eventsfile C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\temp\junit4-J0-20140320_025140_500.events @C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\temp\junit4-J0-20140320_025140_500.suites
   [junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 240. Very likely a JVM crash.  Process output piped in logs above.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1458)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:133)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:945)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:942)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4] 	at java.lang.Thread.run(Thread.java:744)

BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: At least one slave process threw an exception, first: Forked process returned with error code: 240. Very likely a JVM crash.  Process output piped in logs above.

Total time: 77 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0) - Build # 3876 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3876/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
commitWithin did not work expected:<68> but was:<67>

Stack Trace:
java.lang.AssertionError: commitWithin did not work expected:<68> but was:<67>
	at __randomizedtesting.SeedInfo.seed([9D437D9719B2DB69:1CA5F38F6EEDBB55]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:358)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10182 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> 336351 T1561 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 336353 T1561 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-BasicDistributedZkTest-1395259720701
   [junit4]   2> 336355 T1561 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 336368 T1562 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 336436 T1561 oasc.ZkTestServer.run start zk server on port:54019
   [junit4]   2> 336438 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 336445 T1568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86093e2 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 336445 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 336445 T1561 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 336450 T1563 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dbf5c40e0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 336451 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 336454 T1570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34613617 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 336454 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 336455 T1561 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 336459 T1561 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 336464 T1561 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 336466 T1561 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 336470 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 336470 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 336476 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 336476 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 336480 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 336480 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 336483 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 336483 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 336486 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 336487 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 336490 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 336490 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 336493 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 336493 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 336496 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 336496 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 336499 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 336499 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 336502 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 336502 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 336506 T1561 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 336506 T1561 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 336509 T1563 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dbf5c40e0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 337802 T1561 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 337808 T1561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54026
   [junit4]   2> 337808 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 337808 T1561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 337808 T1561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856
   [junit4]   2> 337808 T1561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856\'
   [junit4]   2> 337829 T1561 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856\solr.xml
   [junit4]   2> 337839 T1561 oasc.CoreContainer.<init> New CoreContainer 1130521747
   [junit4]   2> 337839 T1561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856\]
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 337839 T1561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 337841 T1561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 337842 T1561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 337842 T1561 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 337842 T1561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
   [junit4]   2> 337843 T1561 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 337844 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 337849 T1581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7793252f name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 337850 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 337852 T1563 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dbf5c40e0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 337854 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 337855 T1583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74eb2647 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 337855 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 337857 T1561 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 337861 T1561 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 337864 T1561 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 337869 T1561 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 337873 T1561 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 337877 T1561 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 337880 T1561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54026_
   [junit4]   2> 337880 T1561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54026_
   [junit4]   2> 337885 T1561 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 337888 T1561 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 337894 T1561 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54026_
   [junit4]   2> 337894 T1561 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 337898 T1561 oasc.Overseer.start Overseer (id=91439741056974851-127.0.0.1:54026_-n_0000000000) starting
   [junit4]   2> 337903 T1561 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 337919 T1585 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 337919 T1561 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 337919 T1585 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 337922 T1561 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 337926 T1561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 337929 T1584 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 337933 T1586 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 337933 T1586 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 337935 T1586 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 337935 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 337936 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 337937 T1584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54026",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54026_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 337937 T1584 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 337937 T1584 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 337940 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 337941 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 338716 T1586 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 338716 T1586 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856\collection1
   [junit4]   2> 338716 T1586 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 338718 T1586 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 338718 T1586 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 338721 T1586 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 338721 T1586 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856\collection1\'
   [junit4]   2> 338721 T1586 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856/collection1/lib/.svn/' to classloader
   [junit4]   2> 338722 T1586 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856/collection1/lib/classes/' to classloader
   [junit4]   2> 338722 T1586 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856/collection1/lib/README' to classloader
   [junit4]   2> 338746 T1586 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 338752 T1586 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 338754 T1586 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 338757 T1586 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 338831 T1586 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 338837 T1586 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 338837 T1586 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 338851 T1586 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 338854 T1586 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 338856 T1586 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 338857 T1586 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 338859 T1586 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 338859 T1586 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 338859 T1586 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 338859 T1586 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 338859 T1586 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 338860 T1586 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1395259720856\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/control/data\
   [junit4]   2> 338860 T1586 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d3c1735
   [junit4]   2> 338860 T1586 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/control/data\
   [junit4]   2> 338860 T1586 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/control/data\index/
   [junit4]   2> 338861 T1586 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 338861 T1586 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/control/data\index
   [junit4]   2> 338861 T1586 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6361478110636849]
   [junit4]   2> 338862 T1586 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@77fc7e2c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@44a597f4),segFN=segments_1,generation=1}
   [junit4]   2> 338862 T1586 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 338864 T1586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 338864 T1586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 338864 T1586 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 338864 T1586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 338865 T1586 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 338865 T1586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 338865 T1586 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 338865 T1586 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 338865 T1586 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 338866 T1586 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 338870 T1586 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 338873 T1586 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 338873 T1586 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 338874 T1586 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=1.2109375, floorSegmentMB=0.3837890625, forceMergeDeletesPctAllowed=16.06905923611229, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8043331679352296
   [junit4]   2> 338874 T1586 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@77fc7e2c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@44a597f4),segFN=segments_1,generation=1}
   [junit4]   2> 338874 T1586 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 338875 T1586 oass.SolrIndexSearcher.<init> Opening Searcher@6cf878fb[collection1] main
   [junit4]   2> 338875 T1586 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 338876 T1586 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 338876 T1586 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 338877 T1586 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 338877 T1586 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 338877 T1586 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 338878 T1586 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 338878 T1586 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 338878 T1586 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 338878 T1586 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 338879 T1587 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6cf878fb[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 338880 T1586 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 338882 T1561 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 338882 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 338883 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 338883 T1590 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54026 collection:control_collection shard:shard1
   [junit4]   2> 338885 T1592 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7661a9e6 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 338885 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 338885 T1590 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 338887 T1561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 338890 T1561 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 338894 T1590 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 338898 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338899 T1590 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 338899 T1590 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C195 name=collection1 org.apache.solr.core.SolrCore@7f0630c6 url=http://127.0.0.1:54026/collection1 node=127.0.0.1:54026_ C195_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:54026, core=collection1, node_name=127.0.0.1:54026_}
   [junit4]   2> 338899 T1590 C195 P54026 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54026/collection1/
   [junit4]   2> 338899 T1590 C195 P54026 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 338899 T1590 C195 P54026 oasc.SyncStrategy.syncToMe http://127.0.0.1:54026/collection1/ has no replicas
   [junit4]   2> 338899 T1590 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54026/collection1/ shard1
   [junit4]   2> 338900 T1590 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 338901 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 338933 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338936 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 338940 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 339020 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 339020 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 339055 T1590 oasc.ZkController.register We are http://127.0.0.1:54026/collection1/ and leader is http://127.0.0.1:54026/collection1/
   [junit4]   2> 339055 T1590 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54026
   [junit4]   2> 339055 T1590 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 339055 T1590 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 339055 T1590 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 339059 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 339059 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 339059 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 339059 T1590 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 339060 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 339061 T1584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54026",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54026_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 339063 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 339146 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 339146 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 340292 T1561 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 340293 T1561 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 340297 T1561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54038
   [junit4]   2> 340298 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 340298 T1561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 340299 T1561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237
   [junit4]   2> 340299 T1561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237\'
   [junit4]   2> 340318 T1561 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237\solr.xml
   [junit4]   2> 340330 T1561 oasc.CoreContainer.<init> New CoreContainer 620533784
   [junit4]   2> 340330 T1561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237\]
   [junit4]   2> 340331 T1561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 340334 T1561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 340334 T1561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 340335 T1561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 340335 T1561 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 340335 T1561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
   [junit4]   2> 340335 T1561 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 340337 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 340356 T1603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ccde51b name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 340357 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 340359 T1563 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144dbf5c40e0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 340359 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 340362 T1605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17abbf47 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 340362 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 340370 T1561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 341155 T1561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54038_
   [junit4]   2> 341158 T1561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54038_
   [junit4]   2> 341163 T1605 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 341164 T1583 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 341164 T1592 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 341178 T1606 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 341178 T1606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 341180 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 341181 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 341181 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 341180 T1606 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 341186 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 341187 T1584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54038",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54038_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 341187 T1584 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 341187 T1584 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 341194 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 341196 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 341196 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 341196 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 341964 T1606 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 341964 T1606 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237\collection1
   [junit4]   2> 341966 T1606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 341967 T1606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 341967 T1606 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 341969 T1606 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 341969 T1606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237\collection1\'
   [junit4]   2> 341973 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237/collection1/lib/.svn/' to classloader
   [junit4]   2> 341975 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237/collection1/lib/classes/' to classloader
   [junit4]   2> 341975 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237/collection1/lib/README' to classloader
   [junit4]   2> 342012 T1606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 342018 T1606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 342021 T1606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 342024 T1606 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 342103 T1606 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 342111 T1606 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 342111 T1606 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 342125 T1606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 342127 T1606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 342129 T1606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 342130 T1606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 342131 T1606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 342131 T1606 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 342133 T1606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 342133 T1606 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 342133 T1606 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 342133 T1606 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1395259723237\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty1\
   [junit4]   2> 342133 T1606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d3c1735
   [junit4]   2> 342133 T1606 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty1\
   [junit4]   2> 342133 T1606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty1\index/
   [junit4]   2> 342133 T1606 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 342133 T1606 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty1\index
   [junit4]   2> 342133 T1606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6361478110636849]
   [junit4]   2> 342134 T1606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@70586f07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36f53c4b),segFN=segments_1,generation=1}
   [junit4]   2> 342134 T1606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 342137 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 342137 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 342137 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 342137 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 342138 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 342138 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 342138 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 342139 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 342139 T1606 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 342140 T1606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 342140 T1606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 342140 T1606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 342140 T1606 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 342141 T1606 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 342141 T1606 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 342142 T1606 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 342143 T1606 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 342149 T1606 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 342153 T1606 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 342153 T1606 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 342153 T1606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=1.2109375, floorSegmentMB=0.3837890625, forceMergeDeletesPctAllowed=16.06905923611229, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8043331679352296
   [junit4]   2> 342153 T1606 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@70586f07 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@36f53c4b),segFN=segments_1,generation=1}
   [junit4]   2> 342154 T1606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 342154 T1606 oass.SolrIndexSearcher.<init> Opening Searcher@65c3e7fc[collection1] main
   [junit4]   2> 342154 T1606 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 342156 T1606 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 342156 T1606 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 342157 T1606 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 342157 T1606 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 342157 T1606 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 342158 T1606 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 342158 T1606 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 342158 T1606 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 342158 T1606 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 342160 T1607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65c3e7fc[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 342161 T1606 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 342162 T1561 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 342162 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 342162 T1610 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54038 collection:collection1 shard:shard2
   [junit4]   2> 342164 T1610 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 342175 T1610 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 342180 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342181 T1610 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 342181 T1610 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C196 name=collection1 org.apache.solr.core.SolrCore@ee85b6d url=http://127.0.0.1:54038/collection1 node=127.0.0.1:54038_ C196_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54038, core=collection1, node_name=127.0.0.1:54038_}
   [junit4]   2> 342181 T1610 C196 P54038 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54038/collection1/
   [junit4]   2> 342181 T1610 C196 P54038 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 342181 T1610 C196 P54038 oasc.SyncStrategy.syncToMe http://127.0.0.1:54038/collection1/ has no replicas
   [junit4]   2> 342181 T1610 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54038/collection1/ shard2
   [junit4]   2> 342182 T1610 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 342185 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 342192 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342194 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342198 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342279 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 342280 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 342281 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 342313 T1610 oasc.ZkController.register We are http://127.0.0.1:54038/collection1/ and leader is http://127.0.0.1:54038/collection1/
   [junit4]   2> 342313 T1610 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54038
   [junit4]   2> 342313 T1610 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 342313 T1610 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 342313 T1610 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 342314 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342314 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342314 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342315 T1610 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 342317 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 342317 T1584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54038",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54038_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 342321 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 342402 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 342403 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 342403 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 343675 T1561 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 343676 T1561 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 343681 T1561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54047
   [junit4]   2> 343682 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 343682 T1561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 343682 T1561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509
   [junit4]   2> 343683 T1561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509\'
   [junit4]   2> 343717 T1561 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509\solr.xml
   [junit4]   2> 343732 T1561 oasc.CoreContainer.<init> New CoreContainer 1093203517
   [junit4]   2> 343732 T1561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509\]
   [junit4]   2> 343734 T1561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 343734 T1561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 343734 T1561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 343734 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 343734 T1561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 343734 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 343736 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 343736 T1561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 343736 T1561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 343736 T1561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 343738 T1561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 343738 T1561 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 343738 T1561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
   [junit4]   2> 343738 T1561 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 343743 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 343759 T1621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57d33c08 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 343760 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 343769 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 343773 T1623 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b3d1a41 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 343773 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 343810 T1561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 344674 T1561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54047_
   [junit4]   2> 344676 T1561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54047_
   [junit4]   2> 344679 T1605 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 344679 T1623 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 344680 T1592 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 344681 T1583 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 344692 T1624 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 344692 T1624 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 344693 T1624 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 344693 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 344693 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 344694 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 344696 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 344697 T1584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54047",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54047_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 344697 T1584 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 344697 T1584 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 344704 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 344705 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 344705 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 344705 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 344705 T1623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 345553 T1624 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 345553 T1624 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509\collection1
   [junit4]   2> 345553 T1624 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 345554 T1624 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 345554 T1624 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 345556 T1624 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 345556 T1624 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509\collection1\'
   [junit4]   2> 345558 T1624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509/collection1/lib/.svn/' to classloader
   [junit4]   2> 345561 T1624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509/collection1/lib/classes/' to classloader
   [junit4]   2> 345561 T1624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509/collection1/lib/README' to classloader
   [junit4]   2> 345601 T1624 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 345608 T1624 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 345611 T1624 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 345613 T1624 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 345696 T1624 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 345701 T1624 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 345701 T1624 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 345715 T1624 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 345718 T1624 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 345721 T1624 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 345722 T1624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 345722 T1624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 345722 T1624 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 345723 T1624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 345723 T1624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 345723 T1624 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 345724 T1624 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1395259726509\collection1\, dataDir=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty2\
   [junit4]   2> 345724 T1624 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d3c1735
   [junit4]   2> 345725 T1624 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty2\
   [junit4]   2> 345725 T1624 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty2\index/
   [junit4]   2> 345725 T1624 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 345725 T1624 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty2\index
   [junit4]   2> 345726 T1624 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6361478110636849]
   [junit4]   2> 345726 T1624 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@662456d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@442a8097),segFN=segments_1,generation=1}
   [junit4]   2> 345726 T1624 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 345728 T1624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 345728 T1624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 345728 T1624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 345729 T1624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 345729 T1624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 345729 T1624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 345730 T1624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 345730 T1624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 345730 T1624 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 345730 T1624 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 345731 T1624 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 345731 T1624 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 345731 T1624 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 345732 T1624 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 345732 T1624 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 345732 T1624 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 345733 T1624 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 345735 T1624 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 345739 T1624 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 345739 T1624 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 345740 T1624 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=1.2109375, floorSegmentMB=0.3837890625, forceMergeDeletesPctAllowed=16.06905923611229, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8043331679352296
   [junit4]   2> 345740 T1624 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@662456d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@442a8097),segFN=segments_1,generation=1}
   [junit4]   2> 345740 T1624 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 345740 T1624 oass.SolrIndexSearcher.<init> Opening Searcher@6c976dec[collection1] main
   [junit4]   2> 345740 T1624 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 345743 T1624 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 345743 T1624 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 345743 T1624 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 345743 T1624 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 345743 T1624 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 345744 T1624 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 345744 T1624 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 345744 T1624 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 345744 T1624 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 345747 T1625 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c976dec[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 345748 T1624 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 345750 T1561 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 345750 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 345750 T1628 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54047 collection:collection1 shard:shard1
   [junit4]   2> 345752 T1628 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 345764 T1628 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 345767 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345769 T1628 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 345769 T1628 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C197 name=collection1 org.apache.solr.core.SolrCore@b69592d url=http://127.0.0.1:54047/collection1 node=127.0.0.1:54047_ C197_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54047, core=collection1, node_name=127.0.0.1:54047_}
   [junit4]   2> 345769 T1628 C197 P54047 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54047/collection1/
   [junit4]   2> 345769 T1628 C197 P54047 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 345769 T1628 C197 P54047 oasc.SyncStrategy.syncToMe http://127.0.0.1:54047/collection1/ has no replicas
   [junit4]   2> 345769 T1628 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54047/collection1/ shard1
   [junit4]   2> 345769 T1628 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 345771 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 345778 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345780 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345786 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345875 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 345876 T1623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 345876 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 345877 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 345913 T1628 oasc.ZkController.register We are http://127.0.0.1:54047/collection1/ and leader is http://127.0.0.1:54047/collection1/
   [junit4]   2> 345913 T1628 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54047
   [junit4]   2> 345913 T1628 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 345913 T1628 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 345913 T1628 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 345915 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345915 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345915 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 345915 T1628 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 345917 T1584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 345918 T1584 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54047",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54047_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 345921 T1583 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 346013 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 346015 T1623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 346015 T1592 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 346015 T1583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 347323 T1561 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 347324 T1561 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 347327 T1561 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54056
   [junit4]   2> 347328 T1561 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 347329 T1561 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 347329 T1561 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1395259730097
   [junit4]   2> 347329 T1561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1395259730097\'
   [junit4]   2> 347350 T1561 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1395259730097\solr.xml
   [junit4]   2> 347357 T1561 oasc.CoreContainer.<init> New CoreContainer 597007778
   [junit4]   2> 347357 T1561 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1395259730097\]
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 347359 T1561 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 347359 T1561 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 347361 T1561 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 347362 T1561 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 347362 T1561 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54019/solr
   [junit4]   2> 347362 T1561 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 347364 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 347379 T1639 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c16fcf2 name:ZooKeeperConnection Watcher:127.0.0.1:54019 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 347380 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 347393 T1561 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 347398 T1641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b418041 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 347398 T1561 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 347410 T1561 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 348274 T1561 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54056_
   [junit4]   2> 348277 T1561 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54056_
   [junit4]   2> 348286 T1605 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 348286 T1623 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 348287 T1592 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 348287 T1641 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 348287 T1583 oascc.ZkStateReader$3.process Updating live nodes... (4)


[...truncated too long message...]

dateCommits newest commit generation = 8
   [junit4]   2> 366936 T1641 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 366937 T1641 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty3\ [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty3\;done=false>>]
   [junit4]   2> 366939 T1641 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty3\
   [junit4]   2> 366939 T1641 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty3\index [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty3\index;done=false>>]
   [junit4]   2> 366940 T1641 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty3\index
   [junit4]   2> 366941 T1660 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 366941 T1641 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 366944 T1641 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 366944 T1641 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 366944 T1641 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 366944 T1660 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 366946 T1660 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty4\index [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty4\index;done=false>>]
   [junit4]   2> 366946 T1660 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty4\index
   [junit4]   2> 366947 T1660 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty4\ [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty4\;done=false>>]
   [junit4]   2> 366947 T1660 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.BasicDistributedZkTest-1395259720700/jetty4\
   [junit4]   2> 366947 T1660 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 366948 T1660 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 367009 T1682 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b26ec29 name:ZooKeeperConnection Watcher:127.0.0.1:54019/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 367009 T1682 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=9D437D9719B2DB69 -Dtests.slow=true -Dtests.locale=lt -Dtests.timezone=Africa/Brazzaville -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 30.7s | BasicDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: commitWithin did not work expected:<68> but was:<67>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([9D437D9719B2DB69:1CA5F38F6EEDBB55]:0)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:358)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 367051 T1561 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 30710 T1560 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=69), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=69)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=lt, timezone=Africa/Brazzaville
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=2,threads=1,free=37430840,total=231735296
   [junit4]   2> NOTE: All tests run in this JVM: [SoftAutoCommitTest, TestManagedResourceStorage, SuggesterTSTTest, TestJoin, DisMaxRequestHandlerTest, TestExceedMaxTermLength, TestNonNRTOpen, DirectSolrConnectionTest, SuggesterWFSTTest, TestUtils, OverseerTest, TestStressReorder, ModifyConfFileTest, TestWordDelimiterFilterFactory, DocValuesMultiTest, TestAnalyzedSuggestions, TestShortCircuitedRequests, TestNRTOpen, TestSearchPerf, SimplePostToolTest, MBeansHandlerTest, TestPhraseSuggestions, TestFaceting, TestFieldTypeResource, OverseerRolesTest, TestLRUCache, TestBlendedInfixSuggestions, TestSurroundQueryParser, TestAtomicUpdateErrorCases, TestAnalyzeInfixSuggestions, TestCloudManagedSchemaAddField, DistributedQueryComponentOptimizationTest, CoreAdminCreateDiscoverTest, SolrCoreCheckLockOnStartupTest, ChaosMonkeyNothingIsSafeTest, JsonLoaderTest, TestFastWriter, AddSchemaFieldsUpdateProcessorFactoryTest, ChangedSchemaMergeTest, TestFieldSortValues, TestQuerySenderListener, TestMultiCoreConfBootstrap, SchemaVersionSpecificBehaviorTest, BasicDistributedZkTest]
   [junit4] Completed in 31.25s, 1 test, 1 failure <<< FAILURES!

[...truncated 1098 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 391 suites, 1644 tests, 1 failure, 55 ignored (34 assumptions)

Total time: 73 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_51) - Build # 3875 - Still Failing!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
I'm seeing these locally as well. I think it started after the
zookeeper forceFsync changes.

On Wed, Mar 19, 2014 at 7:09 PM, Policeman Jenkins Server
<je...@thetaphi.de> wrote:
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3875/
> Java: 32bit/jdk1.7.0_51 -server -XX:+UseConcMarkSweepGC
>
> 11 tests failed.
> FAILED:  junit.framework.TestSuite.org.apache.solr.CursorPagingTest
>
> Error Message:
> org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>
> Stack Trace:
> java.lang.RuntimeException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:142)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:147)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:98)
>         at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:564)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:556)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:365)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:352)
>         at org.apache.solr.CursorPagingTest.beforeTests(CursorPagingTest.java:63)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:766)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>         at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>         at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:137)
>         ... 29 more
> Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>         ... 37 more
>
>
> REGRESSION:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch
>
> Error Message:
>
>
> Stack Trace:
> org.apache.solr.common.cloud.ZooKeeperException:
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:8954838857DCA7C3]:0)
>         at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:249)
>         at org.apache.solr.cloud.AbstractFullDistribZkTestBase.initCloud(AbstractFullDistribZkTestBase.java:256)
>         at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:312)
>         at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /live_nodes
>         at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
>         at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>         at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
>         at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
>         at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
>         at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
>         at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
>         at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:299)
>         at org.apache.solr.client.solrj.impl.CloudSolrServer.connect(CloudSolrServer.java:242)
>         ... 42 more
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
>
> Error Message:
> ERROR: SolrZkClient opens=4 closes=3
>
> Stack Trace:
> java.lang.AssertionError: ERROR: SolrZkClient opens=4 closes=3
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:435)
>         at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
>         at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:789)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
>
> Error Message:
> 2 threads leaked from SUITE scope at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest:     1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)    2) Thread[id=2298, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-EventThread, state=WAITING, group=TGRP-FullSolrCloudDistribCmdsTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest:
>    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
>         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    2) Thread[id=2298, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-EventThread, state=WAITING, group=TGRP-FullSolrCloudDistribCmdsTest]
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
>
> Error Message:
> There are still zombie threads that couldn't be terminated:    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)         at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)         at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)         at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>
> Stack Trace:
> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
>         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
>         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
>         at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
>         at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
>         at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
>         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>
>
> REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testDiscovery
>
> Error Message:
> java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>
> Stack Trace:
> org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D52D7254C9C9A86]:0)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>         at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>         at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>         at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
>         at org.apache.solr.core.TestCoreDiscovery.testDiscovery(TestCoreDiscovery.java:137)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>         ... 48 more
>
>
> REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testNoCoreDir
>
> Error Message:
> java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>
> Stack Trace:
> org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D32FFE8D15629B5B]:0)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>         at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>         at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>         at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
>         at org.apache.solr.core.TestCoreDiscovery.testNoCoreDir(TestCoreDiscovery.java:233)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>         ... 48 more
>
>
> REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testDuplicateNames
>
> Error Message:
> Wrong exception thrown on duplicate core names
>
> Stack Trace:
> java.lang.AssertionError: Wrong exception thrown on duplicate core names
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:F3C2BDA47F4F337A]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.assertTrue(Assert.java:43)
>         at org.apache.solr.core.TestCoreDiscovery.testDuplicateNames(TestCoreDiscovery.java:186)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
>
>
> REGRESSION:  org.apache.solr.core.TestCoreDiscovery.testAlternateCoreDir
>
> Error Message:
> java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>
> Stack Trace:
> org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:CDA9B614D93E2DAF]:0)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>         at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>         at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>         at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
>         at org.apache.solr.core.TestCoreDiscovery.testAlternateCoreDir(TestCoreDiscovery.java:210)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>         ... 48 more
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.request.TestFaceting
>
> Error Message:
> org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>
> Stack Trace:
> java.lang.RuntimeException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:142)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:147)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:98)
>         at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:564)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:556)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:365)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:352)
>         at org.apache.solr.request.TestFaceting.beforeClass(TestFaceting.java:43)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:766)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>         at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>         at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:137)
>         ... 29 more
> Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>         ... 37 more
>
>
> FAILED:  junit.framework.TestSuite.org.apache.solr.schema.DocValuesMissingTest
>
> Error Message:
> org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>
> Stack Trace:
> java.lang.RuntimeException: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:142)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:147)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:98)
>         at org.apache.solr.SolrTestCaseJ4.createCore(SolrTestCaseJ4.java:564)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:556)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:365)
>         at org.apache.solr.SolrTestCaseJ4.initCore(SolrTestCaseJ4.java:352)
>         at org.apache.solr.schema.DocValuesMissingTest.beforeClass(DocValuesMissingTest.java:32)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:766)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>         at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>         at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>         at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>         at org.apache.solr.util.TestHarness.<init>(TestHarness.java:137)
>         ... 29 more
> Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>         at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>         at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>         ... 37 more
>
>
>
>
> Build Log:
> [...truncated 10255 lines...]
>    [junit4] Suite: org.apache.solr.core.TestCoreDiscovery
>    [junit4]   2> 827253 T2252 oas.SolrTestCaseJ4.startTrackingSearchers WARN startTrackingSearchers: numOpens=7 numCloses=7
>    [junit4]   2> 827254 T2252 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
>    [junit4]   2> 827254 T2252 oas.SolrTestCaseJ4.initCore ####initCore
>    [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestCoreDiscovery-1395236002225
>    [junit4]   2> 827256 T2252 oas.SolrTestCaseJ4.initCore ####initCore end
>    [junit4]   2> 827260 T2252 oas.SolrTestCaseJ4.setUp ###Starting testDiscovery
>    [junit4]   2> 827319 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>    [junit4]   2> 827319 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
>    [junit4]   2> 827320 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
>    [junit4]   2> 827361 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
>    [junit4]   2> 827475 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
>    [junit4]   2> 827476 T2252 oasc.CoreContainer.<init> New CoreContainer 18029925
>    [junit4]   2> 827476 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
>    [junit4]   2> 827480 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>    [junit4]   2> 827481 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
>    [junit4]   2> 827481 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>    [junit4]   2> 827481 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>    [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>    [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>    [junit4]   2> 827482 T2252 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>    [junit4]   2> 827498 T2252 oasc.SolrCores.allocateLazyCores Allocating transient cache for 2 transient cores
>    [junit4]   2> 827505 T2252 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 827505 T2252 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 827505 T2252 oasc.CoreContainer.load Host Name: 222.333.444.555
>    [junit4]   2> 827505 T2252 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58059/solr
>    [junit4]   2> 827505 T2252 oasc.ZkController.checkChrootPath zkHost includes chroot
>    [junit4]   2> 827510 T2252 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>    [junit4]   2> 828467 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 830499 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 832529 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 834624 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 836856 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 839080 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 841313 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 843545 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 845904 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 848360 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 850817 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 853274 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 855728 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 858369 T2253 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 861246 T2252 oas.SolrTestCaseJ4.tearDown ###Ending testDiscovery
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.method=testDiscovery -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=ISO-8859-1
>    [junit4] ERROR   34.0s | TestCoreDiscovery.testDiscovery <<<
>    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D52D7254C9C9A86]:0)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>    [junit4]    >        at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>    [junit4]    >        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>    [junit4]    >        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>    [junit4]    >        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>    [junit4]    >        at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
>    [junit4]    >        at org.apache.solr.core.TestCoreDiscovery.testDiscovery(TestCoreDiscovery.java:137)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:744)
>    [junit4]    > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>    [junit4]    >        at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>    [junit4]    >        ... 48 more
>    [junit4]   2> 861265 T2252 oas.SolrTestCaseJ4.setUp ###Starting testNoCoreDir
>    [junit4]   2> 861298 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>    [junit4]   2> 861298 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
>    [junit4]   2> 861298 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
>    [junit4]   2> 861339 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
>    [junit4]   2> 861399 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=18029925
>    [junit4]   2> 861459 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\noCoreDir
>    [junit4]   2> 861459 T2252 oasc.CoreContainer.<init> New CoreContainer 9262736
>    [junit4]   2> 861460 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
>    [junit4]   2> 861461 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>    [junit4]   2> 861463 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
>    [junit4]   2> 861463 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>    [junit4]   2> 861463 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>    [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>    [junit4]   2> 861464 T2252 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>    [junit4]   2> 861465 T2252 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>    [junit4]   2> 861479 T2252 oasc.SolrCores.allocateLazyCores Allocating transient cache for 2 transient cores
>    [junit4]   2> 861480 T2252 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 861482 T2252 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 861482 T2252 oasc.CoreContainer.load Host Name: 222.333.444.555
>    [junit4]   2> 861482 T2252 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58059/solr
>    [junit4]   2> 861483 T2252 oasc.ZkController.checkChrootPath zkHost includes chroot
>    [junit4]   2> 861485 T2252 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>    [junit4]   2> 862774 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 865479 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 868179 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 871075 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 874046 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 877019 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 880007 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 882978 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 886134 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 889289 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 892428 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 895551 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 898655 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 901507 T2255 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 904488 T2252 oas.SolrTestCaseJ4.tearDown ###Ending testNoCoreDir
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.method=testNoCoreDir -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=ISO-8859-1
>    [junit4] ERROR   43.2s | TestCoreDiscovery.testNoCoreDir <<<
>    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:D32FFE8D15629B5B]:0)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:150)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:101)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:96)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:83)
>    [junit4]    >        at org.apache.solr.cloud.ZkController.checkChrootPath(ZkController.java:667)
>    [junit4]    >        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:133)
>    [junit4]    >        at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:67)
>    [junit4]    >        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:230)
>    [junit4]    >        at org.apache.solr.core.TestCoreDiscovery.init(TestCoreDiscovery.java:112)
>    [junit4]    >        at org.apache.solr.core.TestCoreDiscovery.testNoCoreDir(TestCoreDiscovery.java:233)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:744)
>    [junit4]    > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:58059 within 30000 ms
>    [junit4]    >        at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
>    [junit4]    >        at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:142)
>    [junit4]    >        ... 48 more
>    [junit4]   2> 904505 T2252 oas.SolrTestCaseJ4.setUp ###Starting testDuplicateNames
>    [junit4]   2> 904559 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>    [junit4]   2> 904561 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
>    [junit4]   2> 904561 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
>    [junit4]   2> 904623 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
>    [junit4]   2> 904741 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
>    [junit4]   2> 904741 T2252 oasc.CoreContainer.<init> New CoreContainer 31126436
>    [junit4]   2> 904743 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
>    [junit4]   2> 904745 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>    [junit4]   2> 904745 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
>    [junit4]   2> 904745 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>    [junit4]   2> 904746 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 904746 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>    [junit4]   2> 904746 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 904748 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>    [junit4]   2> 904748 T2252 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>    [junit4]   2> 904748 T2252 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>    [junit4]   2> 904761 T2252 oasc.SolrCores.allocateLazyCores Allocating transient cache for 2 transient cores
>    [junit4]   2> 904762 T2252 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 904762 T2252 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 904762 T2252 oasc.CoreContainer.load Host Name: 222.333.444.555
>    [junit4]   2> 904764 T2252 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58059/solr
>    [junit4]   2> 904764 T2252 oasc.ZkController.checkChrootPath zkHost includes chroot
>    [junit4]   2> 904766 T2252 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>    [junit4]   2> 906120 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 908947 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 911777 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 914345 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 916900 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 919456 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 922005 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 924490 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 926789 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 929087 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 931388 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 933676 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 935858 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 937927 T2257 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused: no further information
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> 940125 T2252 oas.SolrTestCaseJ4.tearDown ###Ending testDuplicateNames
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.method=testDuplicateNames -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=es_CR -Dtests.timezone=Europe/Kaliningrad -Dtests.file.encoding=ISO-8859-1
>    [junit4] FAILURE 35.6s | TestCoreDiscovery.testDuplicateNames <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: Wrong exception thrown on duplicate core names
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF:F3C2BDA47F4F337A]:0)
>    [junit4]    >        at org.apache.solr.core.TestCoreDiscovery.testDuplicateNames(TestCoreDiscovery.java:186)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:744)
>    [junit4]   2> 940138 T2252 oas.SolrTestCaseJ4.setUp ###Starting testAlternateCoreDir
>    [junit4]   2> 940179 T2252 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>    [junit4]   2> 940179 T2252 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome
>    [junit4]   2> 940179 T2252 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\'
>    [junit4]   2> 940211 T2252 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\solr.xml
>    [junit4]   2> 940257 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=31126436
>    [junit4]   2> 940258 T3 oasc.CoreContainer.finalize ERROR CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=9262736
>    [junit4]   2> 940321 T2252 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\alternateCoreDir
>    [junit4]   2> 940322 T2252 oasc.CoreContainer.<init> New CoreContainer 21706393
>    [junit4]   2> 940322 T2252 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.core.TestCoreDiscovery\solrHome\]
>    [junit4]   2> 940324 T2252 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>    [junit4]   2> 940324 T2252 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
>    [junit4]   2> 940324 T2252 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>    [junit4]   2> 940325 T2252 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 940325 T2252 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>    [junit4]
>
> [...truncated too long message...]
>
> adLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
>    [junit4]   2>           1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
>    [junit4]   2>                at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
>    [junit4]   2>                at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
>    [junit4]   2>                at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
>    [junit4]   2>                at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
>    [junit4]   2>                at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
>    [junit4]   2>                at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
>    [junit4]   2>                at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>    [junit4]   2>                at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>    [junit4]   2>                at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
>    [junit4]   2>                at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2> 1072365 T2297 oaz.ClientCnxn$SendThread.run WARN Session 0x144da8f206e0003 for server null, unexpected error, closing socket connection and attempting reconnect java.nio.channels.ClosedByInterruptException
>    [junit4]   2>        at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202)
>    [junit4]   2>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:775)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>    [junit4]   2>        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]   2>
>    [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=11), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=11)), sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=iw, timezone=GB-Eire
>    [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_51 (32-bit)/cpus=2,threads=2,free=74795528,total=231591936
>    [junit4]   2> NOTE: All tests run in this JVM: [SpellCheckCollatorTest, CacheHeaderTest, TestSchemaSimilarityResource, PreAnalyzedFieldTest, FastVectorHighlighterTest, DistributedQueryComponentOptimizationTest, PeerSyncTest, NotRequiredUniqueKeyTest, SolrCoreTest, TestFastLRUCache, ScriptEngineTest, TestManagedResourceStorage, StandardRequestHandlerTest, TestBadConfig, DeleteInactiveReplicaTest, TestCharFilters, SuggesterTSTTest, TestSolrDeletionPolicy2, SliceStateTest, FieldAnalysisRequestHandlerTest, RAMDirectoryFactoryTest, IndexSchemaTest, TestHashPartitioner, ClusterStateUpdateTest, SchemaVersionSpecificBehaviorTest, TestSearchPerf, TestDFRSimilarityFactory, DistributedSpellCheckComponentTest, SyncSliceTest, TestCustomSort, ShardRoutingCustomTest, TestLRUCache, ConvertedLegacyTest, StressHdfsTest, TestIBSimilarityFactory, TestLMJelinekMercerSimilarityFactory, HighlighterConfigTest, DirectUpdateHandlerOptimizeTest, TestMultiCoreConfBootstrap, TestDistributedSearch, ZkCLITest, TestFieldSortValues, TestJoin, TestSolrJ, BadComponentTest, HdfsLockFactoryTest, SpellPossibilityIteratorTest, TestRealTimeGet, TestReload, SolrIndexSplitterTest, RangeFacetTest, TestArbitraryIndexDir, URLClassifyProcessorTest, ResourceLoaderTest, TestRTGBase, LeaderElectionTest, ModifyConfFileTest, TestInfoStreamLogging, ExternalFileFieldSortTest, ConnectionManagerTest, TestSolrCoreProperties, XmlUpdateRequestHandlerTest, OutputWriterTest, DocValuesMultiTest, CSVRequestHandlerTest, TestWriterPerf, DistributedTermsComponentTest, TestCloudManagedSchemaAddField, HardAutoCommitTest, ParsingFieldUpdateProcessorsTest, RemoteQueryErrorTest, TestNRTOpen, SolrRequestParserTest, UpdateRequestProcessorFactoryTest, DistributedDebugComponentTest, TermVectorComponentTest, CurrencyFieldOpenExchangeTest, TestSweetSpotSimilarityFactory, ExpressionTest, AddBlockUpdateTest, SortByFunctionTest, TestCoreDiscovery, TestFaceting, DocValuesMissingTest, SpellingQueryConverterTest, CursorPagingTest, FullSolrCloudDistribCmdsTest]
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=FullSolrCloudDistribCmdsTest -Dtests.seed=8B20D902083C7FF -Dtests.slow=true -Dtests.locale=iw -Dtests.timezone=GB-Eire -Dtests.file.encoding=ISO-8859-1
>    [junit4] ERROR   0.00s | FullSolrCloudDistribCmdsTest (suite) <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=4 closes=3
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>    [junit4]    >        at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:435)
>    [junit4]    >        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:180)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:744)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest:
>    [junit4]    >    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>    [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>    [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>    [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
>    [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]    >    2) Thread[id=2298, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-EventThread, state=WAITING, group=TGRP-FullSolrCloudDistribCmdsTest]
>    [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>    [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
>    [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
>    [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>    [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
>    [junit4]    >    1) Thread[id=2297, name=TEST-FullSolrCloudDistribCmdsTest.testDistribSearch-seed#[8B20D902083C7FF]-SendThread(127.0.0.1:58286), state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
>    [junit4]    >         at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
>    [junit4]    >         at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
>    [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
>    [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>    [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>    [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
>    [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8B20D902083C7FF]:0)
>    [junit4] Completed in 30.45s, 1 test, 1 failure, 3 errors <<< FAILURES!
>
> [...truncated 920 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1275: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 391 suites, 1573 tests, 6 suite-level errors, 4 errors, 1 failure, 1232 ignored (22 assumptions)
>
> Total time: 47 minutes 38 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 32bit/jdk1.7.0_51 -server -XX:+UseConcMarkSweepGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org



-- 
Regards,
Shalin Shekhar Mangar.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org