You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/24 18:57:51 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_40-ea-b09) - Build # 4510 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4510/
Java: 64bit/jdk1.8.0_40-ea-b09 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: true)

4 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([4088AAB4ADEDE139:C16E24ACDAB28105]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.client.solrj.impl.CloudSolrServerTest.allTests(CloudSolrServerTest.java:225)
	at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:124)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest

Error Message:
ERROR: SolrZkClient opens=19 closes=18

Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=19 closes=18
	at __randomizedtesting.SeedInfo.seed([4088AAB4ADEDE139]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:462)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:188)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest

Error Message:
8 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest:     1) Thread[id=222, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-SendThread(127.0.0.1:62655), state=RUNNABLE, group=TGRP-CloudSolrServerTest]         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)    2) Thread[id=223, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)    3) Thread[id=261, name=zkCallback-31-thread-3, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=231, name=CloudSolrServer ThreadPool-30-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=243, name=zkCallback-31-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    6) Thread[id=224, name=zkCallback-31-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    7) Thread[id=230, name=CloudSolrServer ThreadPool-30-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    8) Thread[id=262, name=zkCallback-31-thread-4, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 8 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest: 
   1) Thread[id=222, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-SendThread(127.0.0.1:62655), state=RUNNABLE, group=TGRP-CloudSolrServerTest]
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   2) Thread[id=223, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   3) Thread[id=261, name=zkCallback-31-thread-3, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=231, name=CloudSolrServer ThreadPool-30-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=243, name=zkCallback-31-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   6) Thread[id=224, name=zkCallback-31-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   7) Thread[id=230, name=CloudSolrServer ThreadPool-30-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   8) Thread[id=262, name=zkCallback-31-thread-4, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([4088AAB4ADEDE139]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=222, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-SendThread(127.0.0.1:62655), state=RUNNABLE, group=TGRP-CloudSolrServerTest]         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)    2) Thread[id=261, name=zkCallback-31-thread-3, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=231, name=CloudSolrServer ThreadPool-30-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=243, name=zkCallback-31-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=224, name=zkCallback-31-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    6) Thread[id=230, name=CloudSolrServer ThreadPool-30-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    7) Thread[id=262, name=zkCallback-31-thread-4, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=222, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-SendThread(127.0.0.1:62655), state=RUNNABLE, group=TGRP-CloudSolrServerTest]
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   2) Thread[id=261, name=zkCallback-31-thread-3, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=231, name=CloudSolrServer ThreadPool-30-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=243, name=zkCallback-31-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=224, name=zkCallback-31-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   6) Thread[id=230, name=CloudSolrServer ThreadPool-30-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   7) Thread[id=262, name=zkCallback-31-thread-4, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([4088AAB4ADEDE139]:0)




Build Log:
[...truncated 10892 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\init-core-data-001
   [junit4]   2> 57954 T80 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 57958 T80 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /tnmp/np
   [junit4]   2> 57964 T80 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
   [junit4]   2> 57969 T80 oas.SolrTestCaseJ4.setUp ###Starting testWrongZkChrootTest
   [junit4]   2> 57997 T80 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 58032 T81 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 58249 T80 oasc.ZkTestServer.run start zk server on port:62642
   [junit4]   2> 58254 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 58376 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 58412 T82 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
   [junit4]   2> 59792 T88 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a569792 name:ZooKeeperConnection Watcher:127.0.0.1:62642 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 59792 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 59792 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 59797 T80 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 59851 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 59852 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 59858 T91 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a3ee35a name:ZooKeeperConnection Watcher:127.0.0.1:62642/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 59858 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 59858 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 59862 T80 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 59873 T80 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 59884 T80 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 59892 T80 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 59900 T80 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 59902 T80 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 59908 T80 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 59910 T80 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\stopwords.txt because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\protwords.txt because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\currency.xml because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\enumsConfig.xml because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\open-exchange-rates.json because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\mapping-ISOLatin1Accent.txt because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\old_synonyms.txt because it doesn't exist
   [junit4]   2> 59916 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\synonyms.txt because it doesn't exist
   [junit4]   2> 59942 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 59946 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 59961 T94 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45f35008 name:ZooKeeperConnection Watcher:127.0.0.1:62642/solr/xyz/foo got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 59962 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 59962 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 59964 T80 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 59975 T80 oas.SolrTestCaseJ4.tearDown ###Ending testWrongZkChrootTest
   [junit4]   2> 59978 T80 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62642 62642
   [junit4]   2> 61705 T81 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62642 62642
   [junit4]   2> 61749 T80 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 61752 T80 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 61754 T95 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 61830 T80 oasc.ZkTestServer.run start zk server on port:62655
   [junit4]   2> 61830 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 61833 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 61838 T102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3eb99ed9 name:ZooKeeperConnection Watcher:127.0.0.1:62655 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 61839 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 61839 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 61839 T80 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 61845 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 61847 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 61849 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39e76cfa name:ZooKeeperConnection Watcher:127.0.0.1:62655/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 61849 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 61849 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 61849 T80 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 61856 T80 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 61862 T80 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 61868 T80 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 61874 T80 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 61874 T80 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 61881 T80 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 61881 T80 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 61886 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml because it doesn't exist
   [junit4]   2> 61887 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\stopwords.txt because it doesn't exist
   [junit4]   2> 61887 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\protwords.txt because it doesn't exist
   [junit4]   2> 61887 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\currency.xml because it doesn't exist
   [junit4]   2> 61887 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\enumsConfig.xml because it doesn't exist
   [junit4]   2> 61887 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\open-exchange-rates.json because it doesn't exist
   [junit4]   2> 61889 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\mapping-ISOLatin1Accent.txt because it doesn't exist
   [junit4]   2> 61889 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\old_synonyms.txt because it doesn't exist
   [junit4]   2> 61889 T80 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\synonyms.txt because it doesn't exist
   [junit4]   2> 62365 T80 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 62370 T80 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62662
   [junit4]   2> 62370 T80 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 62370 T80 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 62370 T80 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-003
   [junit4]   2> 62371 T80 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-003\'
   [junit4]   2> 62410 T80 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-003\solr.xml
   [junit4]   2> 62424 T80 oasc.CoreContainer.<init> New CoreContainer 1348729515
   [junit4]   2> 62425 T80 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-003\]
   [junit4]   2> 62425 T80 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 62426 T80 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 62427 T80 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 62429 T80 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 62429 T80 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 62429 T80 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 62429 T80 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 62431 T80 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62655/solr
   [junit4]   2> 62466 T80 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 62466 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 62469 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 62478 T117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31be6754 name:ZooKeeperConnection Watcher:127.0.0.1:62655 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 62479 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 62479 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 62505 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 62515 T120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@139c259f name:ZooKeeperConnection Watcher:127.0.0.1:62655/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 62517 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 62539 T80 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 62556 T80 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 62569 T80 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 62579 T80 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 62585 T80 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 62600 T80 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 62602 T80 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62662_tnmp%2Fnp
   [junit4]   2> 62606 T80 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62662_tnmp%2Fnp
   [junit4]   2> 62613 T80 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 62617 T80 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 62621 T80 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 62634 T80 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:62662_tnmp%2Fnp
   [junit4]   2> 62635 T80 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 62639 T80 oasc.Overseer.start Overseer (id=93024666316898307-127.0.0.1:62662_tnmp%2Fnp-n_0000000000) starting
   [junit4]   2> 62654 T80 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 62697 T80 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 62718 T80 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 62721 T122 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 62728 T80 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 62737 T80 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 62771 T121 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 62775 T124 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 62776 T124 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 62793 T124 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 62812 T121 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62662/tnmp/np",
   [junit4]   2> 	  "node_name":"127.0.0.1:62662_tnmp%2Fnp",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 62847 T121 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62662/tnmp/np",
   [junit4]   2> 	  "node_name":"127.0.0.1:62662_tnmp%2Fnp",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 62855 T121 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 62896 T121 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 62914 T120 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 63091 T125 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 63637 T124 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 63637 T124 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 63638 T124 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 63639 T124 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 63640 T124 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 63641 T124 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-003\collection1\'
   [junit4]   2> 63668 T124 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 63677 T124 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 63688 T124 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 63694 T124 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 63699 T124 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 63713 T124 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 63921 T124 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 63923 T124 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 63924 T124 oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 63924 T124 oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 63938 T124 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 63938 T124 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 63938 T124 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/control/data\
   [junit4]   2> 63938 T124 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 63939 T124 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/control/data\
   [junit4]   2> 63939 T124 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/control/data\index/
   [junit4]   2> 63939 T124 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 63940 T124 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/control/data\index
   [junit4]   2> 63941 T124 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@19adbaa7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@741e8b67),segFN=segments_1,generation=1}
   [junit4]   2> 63941 T124 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 63943 T124 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 63947 T124 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 63947 T124 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 63947 T124 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 63947 T124 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 63948 T124 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 63948 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 63949 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 63950 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 63950 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 63952 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 63952 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 63952 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 63952 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 63966 T124 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 63966 T124 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 63966 T124 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 63966 T124 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 63966 T124 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 63967 T124 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 63967 T124 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 63967 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 63980 T124 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 63985 T124 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 63986 T124 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 63987 T124 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 63989 T124 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 63989 T124 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 63991 T124 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 63991 T124 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 63995 T124 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@19adbaa7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@741e8b67),segFN=segments_1,generation=1}
   [junit4]   2> 63995 T124 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 63995 T124 oass.SolrIndexSearcher.<init> Opening Searcher@33f353b2[collection1] main
   [junit4]   2> 63997 T124 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 64003 T124 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 64003 T124 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 64012 T124 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 64012 T124 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 64012 T124 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 64013 T124 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 64014 T124 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 64015 T124 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 64023 T124 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 64023 T124 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 64023 T124 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 64032 T124 oasha.AdminHandlers.inform WARN <requestHandler name="/admin/" 
   [junit4]   2> 	 class="solr.admin.AdminHandlers" /> is deprecated . It is not required anymore
   [junit4]   2> 64032 T124 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 64032 T126 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33f353b2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 64036 T80 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 64036 T80 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 64037 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 64040 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 64045 T129 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62662/tnmp/np collection:control_collection shard:shard1
   [junit4]   2> 64047 T132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27eabe2a name:ZooKeeperConnection Watcher:127.0.0.1:62655/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 64052 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 64052 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 64058 T80 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 64071 T129 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 64081 T80 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 64308 T129 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 64313 T129 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 64313 T129 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 64316 T125 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> ASYNC  NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@6e2cd04f url=http://127.0.0.1:62662/tnmp/np/collection1 node=127.0.0.1:62662_tnmp%2Fnp C22_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:62662/tnmp/np, node_name=127.0.0.1:62662_tnmp%2Fnp, state=down}
   [junit4]   2> 64317 T129 C22 P62662 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62662/tnmp/np/collection1/
   [junit4]   2> 64317 T129 C22 P62662 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 64317 T129 C22 P62662 oasc.SyncStrategy.syncToMe http://127.0.0.1:62662/tnmp/np/collection1/ has no replicas
   [junit4]   2> 64318 T129 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62662/tnmp/np/collection1/ shard1
   [junit4]   2> 64321 T121 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 64328 T129 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 64341 T125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 64342 T132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 64430 T80 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 64431 T80 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 64436 T121 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62662/tnmp/np",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 64437 T80 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62674
   [junit4]   2> 64438 T80 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 64439 T80 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 64439 T80 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-004
   [junit4]   2> 64440 T80 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-004\'
   [junit4]   2> 64450 T120 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 64458 T132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 64484 T80 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-004\solr.xml
   [junit4]   2> 64503 T80 oasc.CoreContainer.<init> New CoreContainer 320516367
   [junit4]   2> 64503 T80 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-004\]
   [junit4]   2> 64505 T80 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 64505 T80 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 64505 T80 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 64505 T80 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 64505 T80 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 64505 T80 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 64506 T80 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 64506 T80 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 64506 T80 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 64506 T80 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 64509 T80 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 64509 T80 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 64509 T80 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 64509 T80 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 64509 T80 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62655/solr
   [junit4]   2> 64509 T80 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 64511 T80 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 64515 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 64537 T129 oasc.ZkController.register We are http://127.0.0.1:62662/tnmp/np/collection1/ and leader is http://127.0.0.1:62662/tnmp/np/collection1/
   [junit4]   2> 64539 T129 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62662/tnmp/np
   [junit4]   2> 64539 T129 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 64539 T129 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 64539 T129 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 64553 T125 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 64554 T144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@617c6bff name:ZooKeeperConnection Watcher:127.0.0.1:62655 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 64558 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 64558 T80 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 64578 T80 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 64579 T121 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62662/tnmp/np",
   [junit4]   2> 	  "node_name":"127.0.0.1:62662_tnmp%2Fnp",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 64580 T121 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62662/tnmp/np",
   [junit4]   2> 	  "node_name":"127.0.0.1:62662_tnmp%2Fnp",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 64590 T147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@677cda22 name:ZooKeeperConnection Watcher:127.0.0.1:62655/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 64590 T80 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 64597 T80 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 64679 T147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 64679 T125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 64679 T132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 65450 T80 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62674_tnmp%2Fnp
   [junit4]   2> 65452 T80 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62674_tnmp%2Fnp
   [junit4]   2> 65460 T80 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 65471 T148 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 65471 T148 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 65473 T125 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 65473 T148 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 65475 T121 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62674/tnmp/np",
   [junit4]   2> 	  "node_name":"127.0.0.1:62674_tnmp%2Fnp",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 65477 T121 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62674/tnmp/np",
   [junit4]   2> 	  "node_name":"127.0.0.1:62674_tnmp%2Fnp",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 65477 T121 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 65478 T121 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 65573 T125 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 65574 T132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 65575 T147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 66316 T148 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 66316 T148 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 66318 T148 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 66318 T148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 66322 T148 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 66322 T148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-004\collection1\'
   [junit4]   2> 66345 T148 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 66349 T148 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 66360 T148 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 66373 T148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 66378 T148 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 66397 T148 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 66515 T148 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 66516 T148 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 66517 T148 oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 66520 T148 oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 66520 T148 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 66523 T148 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 66523 T148 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/jetty1\
   [junit4]   2> 66523 T148 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 66524 T148 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/jetty1\
   [junit4]   2> 66524 T148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/jetty1\index/
   [junit4]   2> 66524 T148 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 66524 T148 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-4088AAB4ADEDE139-001\tempDir-002/jetty1\index
   [junit4]   2> 66525 T148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@31f68127 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33234768),segFN=segments_1,generation=1}
   [junit4]   2> 66525 T148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 66527 T148 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 66527 T148 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 66527 T148 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 66527 T148 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 66527 T148 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 66527 T148 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 66528 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 66529 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 66530 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 66530 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 66530 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 66530 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 66531 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 66531 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 66531 T148 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 66531 T148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 66531 T148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 66532 T148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 66532 T148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 66532 T148 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 66532 T148 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 66532 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 66532 T148 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 66537 T148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 66537 T148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 66538 T148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 66540 T148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 66540 T148 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 66541 T148 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 66541 T148 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 66542 T148 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@31f68127 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@33234768),segFN=segments_1,generation=1}
   [junit4]   2> 66542 T148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 66543 T148 oass.SolrIndexSearcher.<init> Opening Searcher@13e928ca[collection1] main
   [junit4]   2> 66543 T148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 66545 T148 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 66545 T148 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 66546 T148 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 66546 T148 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 66546 T148 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 66548 T148 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 66548 T148 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 66548 T148 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 66548 T148 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 66549 T148 oasha.AdminHandlers.inform WARN <requestHandler name="/admin/" 
   [junit4]   2> 	 class="solr.admin.AdminHandlers" /> is deprecated . It is not required anymore
   [junit4]   2> 66549 T148 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 66550 T149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13e928ca[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 66552 T152 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62674/tnmp/np collection:collection1 shard:shard2
   [junit4]   2> 66554 T80 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 66554 T80 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 66583 T152 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 66848 T152 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 66853 T125 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 66854 T121 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 5
   [junit4]   2> 66861 T152 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 66861 T152 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new l

[...truncated too long message...]

Thread.java:745)
   [junit4]    >    8) Thread[id=262, name=zkCallback-31-thread-4, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4088AAB4ADEDE139]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=222, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[4088AAB4ADEDE139]-SendThread(127.0.0.1:62655), state=RUNNABLE, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]    >         at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]    >         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
   [junit4]    >         at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]    >    2) Thread[id=261, name=zkCallback-31-thread-3, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=231, name=CloudSolrServer ThreadPool-30-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=243, name=zkCallback-31-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=224, name=zkCallback-31-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    6) Thread[id=230, name=CloudSolrServer ThreadPool-30-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    7) Thread[id=262, name=zkCallback-31-thread-4, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4088AAB4ADEDE139]:0)
   [junit4] Completed in 83.75s, 3 tests, 2 failures, 2 errors <<< FAILURES!

[...truncated 145 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:519: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:200: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:510: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1349: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:956: There were test failures: 52 suites, 329 tests, 3 suite-level errors, 1 failure, 269 ignored

Total time: 161 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_40-ea-b09 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_20) - Build # 4511 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4511/
Java: 32bit/jdk1.8.0_20 -server -XX:+UseParallelGC (asserts: true)

All tests passed

Build Log:
[...truncated 52017 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:519: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:426: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:105: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:204: The following files are missing svn:eol-style (or binary svn:mime-type):
* ./solr/core/src/test/org/apache/solr/cloud/TestRebalanceLeaders.java

Total time: 183 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -server -XX:+UseParallelGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any