You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/01/05 20:58:02 UTC

[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3909 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3909/

4 tests failed.
FAILED:  org.apache.solr.search.stats.TestDistribIDF.testMultiCollectionQuery

Error Message:
Could not create collection. Response{responseHeader={status=0,QTime=90423},success={null={responseHeader={status=0,QTime=1450},core=collection1_local_shard2_replica1}},failure={null=org.apache.solr.client.solrj.SolrServerException:Timeout occured while waiting response from server at: https://127.0.0.1:46969/solr}}

Stack Trace:
java.lang.AssertionError: Could not create collection. Response{responseHeader={status=0,QTime=90423},success={null={responseHeader={status=0,QTime=1450},core=collection1_local_shard2_replica1}},failure={null=org.apache.solr.client.solrj.SolrServerException:Timeout occured while waiting response from server at: https://127.0.0.1:46969/solr}}
	at __randomizedtesting.SeedInfo.seed([359EE2EE6DD218AF:24ED25DFB1A41DD3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.search.stats.TestDistribIDF.createCollection(TestDistribIDF.java:215)
	at org.apache.solr.search.stats.TestDistribIDF.createCollection(TestDistribIDF.java:190)
	at org.apache.solr.search.stats.TestDistribIDF.testMultiCollectionQuery(TestDistribIDF.java:157)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
some core start times did not change on reload

Stack Trace:
java.lang.AssertionError: some core start times did not change on reload
	at __randomizedtesting.SeedInfo.seed([359EE2EE6DD218AF:BDCADD34C32E7557]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:743)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:160)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
5 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=5158, name=zkCallback-529-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=5006, name=zkCallback-529-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=5004, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-SendThread(127.0.0.1:41262), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)    4) Thread[id=5005, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)    5) Thread[id=5141, name=zkCallback-529-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=5158, name=zkCallback-529-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=5006, name=zkCallback-529-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=5004, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-SendThread(127.0.0.1:41262), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
   4) Thread[id=5005, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   5) Thread[id=5141, name=zkCallback-529-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([359EE2EE6DD218AF]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=5006, name=zkCallback-529-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=5004, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-SendThread(127.0.0.1:41262), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)    3) Thread[id=5158, name=zkCallback-529-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=5141, name=zkCallback-529-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=5006, name=zkCallback-529-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=5004, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-SendThread(127.0.0.1:41262), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
   3) Thread[id=5158, name=zkCallback-529-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=5141, name=zkCallback-529-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([359EE2EE6DD218AF]:0)




Build Log:
[...truncated 10041 lines...]
   [junit4] Suite: org.apache.solr.search.stats.TestDistribIDF
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/init-core-data-001
   [junit4]   2> 399494 INFO  (SUITE-TestDistribIDF-seed#[359EE2EE6DD218AF]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 399501 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSimpleQuery
   [junit4]   2> 399501 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 399505 INFO  (Thread-840) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 399505 INFO  (Thread-840) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 399605 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.ZkTestServer start zk server on port:45639
   [junit4]   2> 399605 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 399627 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399665 INFO  (zkCallback-202-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@673c740b name:ZooKeeperConnection Watcher:127.0.0.1:45639 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 399665 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399666 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 399666 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 399668 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/clusterprops.json
   [junit4]   2> 399747 INFO  (jetty-launcher-201-thread-2) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 399761 INFO  (jetty-launcher-201-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4aec9787{/solr,null,AVAILABLE}
   [junit4]   2> 399775 INFO  (jetty-launcher-201-thread-3) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 399785 INFO  (jetty-launcher-201-thread-1) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 399799 INFO  (jetty-launcher-201-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@320ad239{/solr,null,AVAILABLE}
   [junit4]   2> 399886 INFO  (jetty-launcher-201-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ca1760a{/solr,null,AVAILABLE}
   [junit4]   2> 399975 INFO  (jetty-launcher-201-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@1d4b8e6d{SSL-http/1.1}{127.0.0.1:42742}
   [junit4]   2> 399978 INFO  (jetty-launcher-201-thread-3) [    ] o.e.j.s.Server Started @403755ms
   [junit4]   2> 399978 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostPort=42742, hostContext=/solr}
   [junit4]   2> 399978 INFO  (jetty-launcher-201-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@155e403a{SSL-http/1.1}{127.0.0.1:50599}
   [junit4]   2> 399978 INFO  (jetty-launcher-201-thread-2) [    ] o.e.j.s.Server Started @403757ms
   [junit4]   2> 399978 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 399979 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=50599}
   [junit4]   2> 399979 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 399979 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node2'
   [junit4]   2> 399980 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 399980 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 399980 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 399979 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node3'
   [junit4]   2> 399981 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 399981 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 399981 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 399985 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399986 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 399986 INFO  (zkCallback-203-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@270877b9 name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 399986 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399987 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 399987 INFO  (zkCallback-204-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@477303d5 name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 399987 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 399987 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 399987 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 399989 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 399994 INFO  (jetty-launcher-201-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@35c15cc2{SSL-http/1.1}{127.0.0.1:58240}
   [junit4]   2> 399994 INFO  (jetty-launcher-201-thread-1) [    ] o.e.j.s.Server Started @403773ms
   [junit4]   2> 399994 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostPort=58240, hostContext=/solr}
   [junit4]   2> 399995 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4f6de641
   [junit4]   2> 400004 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node1'
   [junit4]   2> 400005 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 400005 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 400005 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400013 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400014 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node2/.
   [junit4]   2> 400014 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.CoreContainer New CoreContainer 416690378
   [junit4]   2> 400014 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node2]
   [junit4]   2> 400014 WARN  (jetty-launcher-201-thread-2) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node2/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node2/lib
   [junit4]   2> 400021 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : https,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 400022 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node3/.
   [junit4]   2> 400022 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.CoreContainer New CoreContainer 1805887612
   [junit4]   2> 400022 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node3]
   [junit4]   2> 400022 WARN  (jetty-launcher-201-thread-3) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node3/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node3/lib
   [junit4]   2> 400023 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : https,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 400025 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 400028 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 400028 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 400028 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45639/solr
   [junit4]   2> 400028 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 400028 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400031 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400031 INFO  (zkCallback-205-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bd6e963 name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400032 INFO  (zkCallback-207-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@118e48b5 name:ZooKeeperConnection Watcher:127.0.0.1:45639 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400035 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400035 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400035 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400035 INFO  (jetty-launcher-201-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400032 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 400037 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 400043 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 400055 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 400055 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45639/solr
   [junit4]   2> 400055 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 400055 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400060 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400065 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400067 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node1/.
   [junit4]   2> 400067 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1279119928
   [junit4]   2> 400067 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node1]
   [junit4]   2> 400067 WARN  (jetty-launcher-201-thread-1) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node1/lib
   [junit4]   2> 400067 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : https,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 400069 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 400071 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 400071 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 400072 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45639/solr
   [junit4]   2> 400072 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 400072 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400072 INFO  (zkCallback-210-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3885ccd0 name:ZooKeeperConnection Watcher:127.0.0.1:45639 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400072 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400072 INFO  (jetty-launcher-201-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400073 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400073 INFO  (zkCallback-209-thread-1-processing-n:127.0.0.1:42742_solr) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6090004 name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400073 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400074 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 400075 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400077 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 400079 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 400081 INFO  (zkCallback-213-thread-1-processing-n:127.0.0.1:50599_solr) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1d64219d name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400088 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400081 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 400089 INFO  (zkCallback-212-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@36f76ef0 name:ZooKeeperConnection Watcher:127.0.0.1:45639 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400089 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400090 INFO  (jetty-launcher-201-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400095 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 400096 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400098 INFO  (zkCallback-214-thread-1-processing-n:127.0.0.1:58240_solr) [n:127.0.0.1:58240_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@417dba89 name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400098 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400103 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 400105 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 400105 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 400107 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 400108 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 400109 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 400110 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 400113 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 400113 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 400114 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50599_solr
   [junit4]   2> 400116 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42742_solr
   [junit4]   2> 400117 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50599_solr
   [junit4]   2> 400117 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42742_solr
   [junit4]   2> 400119 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 400119 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 400120 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 400120 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 400121 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 400121 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 400122 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95159757425344520-127.0.0.1:50599_solr-n_0000000000
   [junit4]   2> 400122 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95159757425344518-127.0.0.1:42742_solr-n_0000000001
   [junit4]   2> 400123 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50599_solr
   [junit4]   2> 400123 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 400123 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95159757425344520-127.0.0.1:50599_solr-n_0000000000 to know if I could be the leader
   [junit4]   2> 400123 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 400124 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.Overseer Overseer (id=95159757425344520-127.0.0.1:50599_solr-n_0000000000) starting
   [junit4]   2> 400138 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 400140 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 400143 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 400144 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 400144 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 400145 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node3/.
   [junit4]   2> 400145 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 400158 INFO  (OverseerStateUpdate-95159757425344520-127.0.0.1:50599_solr-n_0000000000) [n:127.0.0.1:50599_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 400159 INFO  (OverseerCollectionConfigSetProcessor-95159757425344520-127.0.0.1:50599_solr-n_0000000000) [n:127.0.0.1:50599_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 400163 INFO  (OverseerStateUpdate-95159757425344520-127.0.0.1:50599_solr-n_0000000000) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 400171 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
   [junit4]   2> 400171 INFO  (jetty-launcher-201-thread-3) [n:127.0.0.1:42742_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 400173 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 400217 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 400217 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 400218 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node2/.
   [junit4]   2> 400218 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 400221 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
   [junit4]   2> 400221 INFO  (jetty-launcher-201-thread-2) [n:127.0.0.1:50599_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 401147 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58240_solr
   [junit4]   2> 401148 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58240_solr
   [junit4]   2> 401149 INFO  (zkCallback-209-thread-1-processing-n:127.0.0.1:42742_solr) [n:127.0.0.1:42742_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 401149 INFO  (zkCallback-213-thread-1-processing-n:127.0.0.1:50599_solr) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 401151 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 401151 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95159757425344521-127.0.0.1:58240_solr-n_0000000002
   [junit4]   2> 401152 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95159757425344518-127.0.0.1:42742_solr-n_0000000001 to know if I could be the leader
   [junit4]   2> 401152 INFO  (zkCallback-214-thread-1-processing-n:127.0.0.1:58240_solr) [n:127.0.0.1:58240_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 401171 INFO  (zkCallback-213-thread-2-processing-n:127.0.0.1:50599_solr) [n:127.0.0.1:50599_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 401188 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 401188 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 401189 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_359EE2EE6DD218AF-001/tempDir-001/node1/.
   [junit4]   2> 401189 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 401200 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J2
   [junit4]   2> 401200 INFO  (jetty-launcher-201-thread-1) [n:127.0.0.1:58240_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 401200 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401216 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401225 INFO  (zkCallback-215-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f3548fd name:ZooKeeperConnection Watcher:127.0.0.1:45639 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401225 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401225 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401229 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401233 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401235 INFO  (zkCallback-217-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b86dd8f name:ZooKeeperConnection Watcher:127.0.0.1:45639/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401235 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401236 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401236 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellcheckcomponent.xml
   [junit4]   2> 401239 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-null-charfilters-analyzer.xml
   [junit4]   2> 401241 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/regex-boost-processor-test.txt
   [junit4]   2> 401243 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellchecker.xml
   [junit4]   2> 401244 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-dest-should-fail-test.xml
   [junit4]   2> 401248 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesFaceting.xml
   [junit4]   2> 401259 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog-with-delayingcomponent.xml
   [junit4]   2> 401261 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-default-code.xml
   [junit4]   2> 401263 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-numeric.xml
   [junit4]   2> 401264 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_codec.xml
   [junit4]   2> 401266 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-source-should-fail-test.xml
   [junit4]   2> 401268 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema_latest.xml
   [junit4]   2> 401270 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sorts.xml
   [junit4]   2> 401272 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-headers.xml
   [junit4]   2> 401273 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-implicitproperties.xml
   [junit4]   2> 401275 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-bogus-scriptengine-name.xml
   [junit4]   2> 401276 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-types.incl
   [junit4]   2> 401278 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-parsing-update-processor-chains.xml
   [junit4]   2> 401280 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMissing.xml
   [junit4]   2> 401286 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-noopregen.xml
   [junit4]   2> 401288 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field-unique-key.xml
   [junit4]   2> 401290 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-script-updateprocessor.xml
   [junit4]   2> 401292 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-error-solrconfig.xml
   [junit4]   2> 401293 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent.xml
   [junit4]   2> 401295 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-currency.xml
   [junit4]   2> 401297 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-query-parser-init.xml
   [junit4]   2> 401298 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-caching.xml
   [junit4]   2> 401300 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/conditional.updateprocessor.js
   [junit4]   2> 401302 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/compoundDictionary.txt
   [junit4]   2> 401304 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/phrasesuggest.txt
   [junit4]   2> 401305 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-transformers.xml
   [junit4]   2> 401307 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-norms.xml
   [junit4]   2> 401309 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/blendedInfixSuggest.txt
   [junit4]   2> 401310 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-phrasesuggest.xml
   [junit4]   2> 401312 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.dic
   [junit4]   2> 401314 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-HighlighterMaxOffsetTest.xml
   [junit4]   2> 401323 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest-lucene-match-version.xml
   [junit4]   2> 401325 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-functionquery.xml
   [junit4]   2> 401327 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-externalversionconstraint.xml
   [junit4]   2> 401329 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-codec-global-vs-ft-mismatch.xml
   [junit4]   2> 401330 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim.xml
   [junit4]   2> 401332 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMulti.xml
   [junit4]   2> 401334 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-collapseqparser.xml
   [junit4]   2> 401350 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-analytics-query.xml
   [junit4]   2> 401353 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sweetspot.xml
   [junit4]   2> 401354 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-searcher-listeners1.xml
   [junit4]   2> 401356 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-id-and-version-fields-only.xml
   [junit4]   2> 401357 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-schema-mutable-but-not-managed.xml
   [junit4]   2> 401359 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.aff
   [junit4]   2> 401361 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-response-log-component.xml
   [junit4]   2> 401362 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-does-not-exist.xml
   [junit4]   2> 401364 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-required.xml
   [junit4]   2> 401366 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-pos.xml
   [junit4]   2> 401385 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-hash.xml
   [junit4]   2> 401386 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-components-name.xml
   [junit4]   2> 401388 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-mp-solrconfig.xml
   [junit4]   2> 401395 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 401407 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-xinclude.xml
   [junit4]   2> 401410 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/cross-compatible.js
   [junit4]   2> 401411 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_perf.xml
   [junit4]   2> 401413 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-invalid-scriptfile.xml
   [junit4]   2> 401415 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-basic.xml
   [junit4]   2> 401416 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication1.xml
   [junit4]   2> 401418 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-missing-scriptfile.xml
   [junit4]   2> 401419 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-altdirectory.xml
   [junit4]   2> 401421 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distributed-missing-sort.xml
   [junit4]   2> 401422 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 401424 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-tfidf.xml
   [junit4]   2> 401426 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/jasuggest.txt
   [junit4]   2> 401427 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-field.xml
   [junit4]   2> 401429 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/fuzzysuggest.txt
   [junit4]   2> 401430 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-minimal.xml
   [junit4]   2> 401432 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-highlight.xml
   [junit4]   2> 401433 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tieredmergepolicy.xml
   [junit4]   2> 401435 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-blockjoinfacetcomponent.xml
   [junit4]   2> 401436 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-indexed.xml
   [junit4]   2> 401438 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-unsupported-docValues.xml
   [junit4]   2> 401439 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 401441 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmdirichlet.xml
   [junit4]   2> 401442 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-synonym-tokenizer.xml
   [junit4]   2> 401444 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stop-2.txt
   [junit4]   2> 401446 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-non-stored-docvalues.xml
   [junit4]   2> 401447 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim-default-override.xml
   [junit4]   2> 401449 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-plugcollector.xml
   [junit4]   2> 401450 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-uses-default.xml
   [junit4]   2> 401452 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-global-vs-ft-mismatch.xml
   [junit4]   2> 401453 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-warmer.xml
   [junit4]   2> 401456 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema11.xml
   [junit4]   2> 401457 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog.xml
   [junit4]   2> 401459 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-withgethandler.xml
   [junit4]   2> 401460 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmjelinekmercer.xml
   [junit4]   2> 401462 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema12.xml
   [junit4]   2> 401463 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-SOLR-749.xml
   [junit4]   2> 401465 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-hyperbolic.xml
   [junit4]   2> 401466 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master2.xml
   [junit4]   2> 401468 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-bm25.xml
   [junit4]   2> 401469 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 401471 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-preanalyzed.xml
   [junit4]   2> 401472 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-type.xml
   [junit4]   2> 401474 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent-context-filter-query.xml
   [junit4]   2> 401475 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distrib-interval-faceting.xml
   [junit4]   2> 401476 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1.xml
   [junit4]   2> 401478 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-oer-norates.xml
   [junit4]   2> 401479 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-schemaless.xml
   [junit4]   2> 401481 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-default-val.xml
   [junit4]   2> 401482 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-norms.xml
   [junit4]   2> 401483 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/elevate.xml
   [junit4]   2> 401485 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-required-fields.xml
   [junit4]   2> 401486 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doc-expire-update-processor.xml
   [junit4]   2> 401488 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-charfilters.xml
   [junit4]   2> 401490 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender.xml
   [junit4]   2> 401491 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-nontext-analyzer.xml
   [junit4]   2> 401493 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/frenchArticles.txt
   [junit4]   2> 401495 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tolerant-search.xml
   [junit4]   2> 401496 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-has-no-explicit-sim.xml
   [junit4]   2> 401498 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 401499 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-update-processor-chains.xml
   [junit4]   2> 401501 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest.xml
   [junit4]   2> 401503 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor0.js
   [junit4]   2> 401505 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-mergepolicy-nocfs.xml
   [junit4]   2> 401506 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-reqHandler.incl
   [junit4]   2> 401507 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 401509 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spellchecker.xml
   [junit4]   2> 401511 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doctransformers.xml
   [junit4]   2> 401512 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-reversed.xml
   [junit4]   2> 401513 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema.xml
   [junit4]   2> 401515 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-omit-tf-but-not-pos.xml
   [junit4]   2> 401516 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-solcoreproperties.xml
   [junit4]   2> 401518 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 401519 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-1.txt
   [junit4]   2> 401521 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/throw.error.on.add.updateprocessor.js
   [junit4]   2> 401523 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master-throttled.xml
   [junit4]   2> 401524 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-single-dynamic-copy-field.xml
   [junit4]   2> 401526 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-xinclude.xml
   [junit4]   2> 401527 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-elevate.xml
   [junit4]   2> 401529 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-2.txt
   [junit4]   2> 401530 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-complex-phrase.xml
   [junit4]   2> 401532 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1-keepOneBackup.xml
   [junit4]   2> 401533 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-bogus-analysis-parameters.xml
   [junit4]   2> 401534 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stemdict.txt
   [junit4]   2> 401536 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-trie.xml
   [junit4]   2> 401537 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/wdftypes.txt
   [junit4]   2> 401539 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave1.xml
   [junit4]   2> 401540 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-defaults.xml
   [junit4]   2> 401541 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-external-filefield.xml
   [junit4]   2> 401543 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValues.xml
   [junit4]   2> 401544 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy2.xml
   [junit4]   2> 401546 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schemasurround.xml
   [junit4]   2> 401547 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-test-misc.xml
   [junit4]   2> 401549 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema15.xml
   [junit4]   2> 401551 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-class-name-shortening-on-serialization.xml
   [junit4]   2> 401552 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-add-schema-fields-update-processor.xml
   [junit4]   2> 401554 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-collate.xml
   [junit4]   2> 401555 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 401556 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-field.xml
   [junit4]   2> 401558 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-indexconfig.xml
   [junit4]   2> 401559 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad_solrconfig.xml
   [junit4]   2> 401560 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-eff.xml
   [junit4]   2> 401562 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-multivalued.xml
   [junit4]   2> 401563 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/analyzingInfixSuggest.txt
   [junit4]   2> 401565 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-repeater.xml
   [junit4]   2> 401566 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spatial.xml
   [junit4]   2> 401568 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-hash.xml
   [junit4]   2> 401570 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spatial.xml
   [junit4]   2> 401571 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-field-sort-values.xml
   [junit4]   2> 401573 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-1.txt
   [junit4]   2> 401574 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-init-error.xml
   [junit4]   2> 401576 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-customfield.xml
   [junit4]   2> 401577 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-managed-schema-named-schema.xml.xml
   [junit4]   2> 401578 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-paramset.xml
   [junit4]   2> 401580 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-dynamicField.xml
   [junit4]   2> 401581 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 401583 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-folding.xml
   [junit4]   2> 401584 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwithbom.txt
   [junit4]   2> 401586 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missleading.extension.updateprocessor.js.txt
   [junit4]   2> 401587 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-dynamic-multivalued.xml
   [junit4]   2> 401589 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-binaryfield.xml
   [junit4]   2> 401590 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave.xml
   [junit4]   2> 401621 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-luceneMatchVersion.xml
   [junit4]   2> 401622 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sortingresponse.xml
   [junit4]   2> 401623 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-baseline.xml
   [junit4]   2> 401625 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-stop-keep.xml
   [junit4]   2> 401627 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-infostream-logging.xml
   [junit4]   2> 401628 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-is-copyfield-dest.xml
   [junit4]   2> 401629 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master.xml
   [junit4]   2> 401632 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[359EE2EE6DD218AF]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication2.xml
   [junit4]   2> 401633 INFO  

[...truncated too long message...]

ype, UniqFieldsUpdateProcessorFactoryTest, TimeZoneUtilsTest, DistributedDebugComponentTest, RulesTest, LoggingHandlerTest, SpellCheckCollatorTest, TestDFRSimilarityFactory, TestSearcherReuse, CollectionsAPIDistributedZkTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.seed=359EE2EE6DD218AF -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=no_NO -Dtests.timezone=America/Indiana/Indianapolis -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | CollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   [junit4]    >    1) Thread[id=5158, name=zkCallback-529-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=5006, name=zkCallback-529-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=5004, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-SendThread(127.0.0.1:41262), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
   [junit4]    >    4) Thread[id=5005, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   [junit4]    >    5) Thread[id=5141, name=zkCallback-529-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([359EE2EE6DD218AF]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=5006, name=zkCallback-529-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=5004, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[359EE2EE6DD218AF]-SendThread(127.0.0.1:41262), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
   [junit4]    >    3) Thread[id=5158, name=zkCallback-529-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=5141, name=zkCallback-529-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([359EE2EE6DD218AF]:0)
   [junit4] Completed [233/562 (2!)] on J1 in 130.00s, 1 test, 1 failure, 2 errors <<< FAILURES!

[...truncated 1021 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:794: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1000: There were test failures: 562 suites (7 ignored), 2231 tests, 2 suite-level errors, 2 failures, 1197 ignored (35 assumptions) [seed: 359EE2EE6DD218AF]

Total time: 76 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3912 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3912/

4 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([7DCEE06F68BF3374:F59ADFB5C6435E8C]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertFalse(Assert.java:68)
	at org.junit.Assert.assertFalse(Assert.java:79)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoConfigSetExist(CollectionsAPIDistributedZkTest.java:518)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:159)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.DistributedVersionInfoTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:58028/c8n_vers_1x3_shard1_replica3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:58028/c8n_vers_1x3_shard1_replica3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([7DCEE06F68BF3374:F59ADFB5C6435E8C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.DistributedVersionInfoTest.assertDocExists(DistributedVersionInfoTest.java:367)
	at org.apache.solr.cloud.DistributedVersionInfoTest.assertDocsExistInAllReplicas(DistributedVersionInfoTest.java:334)
	at org.apache.solr.cloud.DistributedVersionInfoTest.testReplicaVersionHandling(DistributedVersionInfoTest.java:100)
	at org.apache.solr.cloud.DistributedVersionInfoTest.test(DistributedVersionInfoTest.java:75)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Unexpected achieved replication factor expected:<2> but was:<1>

Stack Trace:
java.lang.AssertionError: Unexpected achieved replication factor expected:<2> but was:<1>
	at __randomizedtesting.SeedInfo.seed([7DCEE06F68BF3374:F59ADFB5C6435E8C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:212)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:104)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.ShardSplitTest.test

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
	at __randomizedtesting.SeedInfo.seed([7DCEE06F68BF3374:F59ADFB5C6435E8C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:136)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:825)
	at org.apache.solr.cloud.ShardSplitTest.splitByUniqueKeyTest(ShardSplitTest.java:219)
	at org.apache.solr.cloud.ShardSplitTest.test(ShardSplitTest.java:82)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9829 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/init-core-data-001
   [junit4]   2> 150287 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[7DCEE06F68BF3374]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 150287 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[7DCEE06F68BF3374]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /zke/sh
   [junit4]   2> 150292 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 150292 INFO  (Thread-591) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 150292 INFO  (Thread-591) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 150392 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.ZkTestServer start zk server on port:36018
   [junit4]   2> 150392 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 150393 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150396 INFO  (zkCallback-120-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f88d1cd name:ZooKeeperConnection Watcher:127.0.0.1:36018 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150396 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150396 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 150396 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 150399 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 150399 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150401 INFO  (zkCallback-121-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ec9030e name:ZooKeeperConnection Watcher:127.0.0.1:36018/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150401 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150401 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 150401 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 150404 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 150410 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 150412 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 150415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 150415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 150418 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 150418 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 150423 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 150424 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 150426 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 150426 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 150428 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 150429 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 150431 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 150431 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 150433 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 150433 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 150435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 150436 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 150438 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 150438 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 150441 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 150441 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 150443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 150443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 150446 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 150447 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150448 INFO  (zkCallback-122-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1466c555 name:ZooKeeperConnection Watcher:127.0.0.1:36018 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150448 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150449 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 150449 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 150450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 150451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150452 INFO  (zkCallback-123-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54e8d586 name:ZooKeeperConnection Watcher:127.0.0.1:36018/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150452 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150453 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 150453 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 150453 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 150456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 150456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 150459 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 150459 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 150461 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 150461 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 150463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 150463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 150465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 150465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 150467 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 150467 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 150469 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 150469 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 150471 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 150471 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 150473 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 150473 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 150474 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 150475 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 150477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 150477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 150769 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1
   [junit4]   2> 150771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 150773 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5c5180ac{/zke/sh,null,AVAILABLE}
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1a3e46{HTTP/1.1}{127.0.0.1:54888}
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.Server Started @153625ms
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/zke/sh, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/tempDir-001/control/data, hostPort=54888, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores}
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@41692a49
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001'
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 150775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 150776 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 150776 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150778 INFO  (zkCallback-124-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67f9c40f name:ZooKeeperConnection Watcher:127.0.0.1:36018/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150778 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150779 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 150780 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 150780 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/solr.xml
   [junit4]   2> 150810 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores
   [junit4]   2> 150811 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.CoreContainer New CoreContainer 304646652
   [junit4]   2> 150811 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001]
   [junit4]   2> 150811 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/lib
   [junit4]   2> 150811 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 150812 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 150813 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 150813 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 150813 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36018/solr
   [junit4]   2> 150813 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 150813 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 150814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150816 INFO  (zkCallback-126-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b4dbde2 name:ZooKeeperConnection Watcher:127.0.0.1:36018 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150816 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150817 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 150818 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 150820 INFO  (zkCallback-127-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2094910d name:ZooKeeperConnection Watcher:127.0.0.1:36018/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 150820 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 150821 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 150824 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 150828 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 150831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 150834 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 150837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 150839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 150841 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 150843 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 150844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54888_zke%2Fsh
   [junit4]   2> 150845 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54888_zke%2Fsh
   [junit4]   2> 150847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 150849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 150851 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 150852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000
   [junit4]   2> 150852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54888_zke%2Fsh
   [junit4]   2> 150852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 150854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer Overseer (id=95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) starting
   [junit4]   2> 150856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 150865 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 150866 INFO  (OverseerCollectionConfigSetProcessor-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 150866 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 150866 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 150910 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 150910 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 150912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores
   [junit4]   2> 150913 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {collection=control_collection, schema=schema.xml, shard=, dataDir=data/, coreNodeName=, configSetProperties=configsetprops.json, config=solrconfig.xml, name=collection1, transient=false, loadOnStartup=true}
   [junit4]   2> 150913 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1
   [junit4]   2> 150913 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 150915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 150915 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 150915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 150915 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 150918 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54888/zke/sh",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "node_name":"127.0.0.1:54888_zke%2Fsh"} current state version: 0
   [junit4]   2> 150918 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 150919 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54888/zke/sh",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "node_name":"127.0.0.1:54888_zke%2Fsh"}
   [junit4]   2> 150919 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 150920 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 150922 INFO  (zkCallback-127-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 151919 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 151919 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 151920 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 151920 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 151921 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 151921 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1'
   [junit4]   2> 151921 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 151921 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 151924 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 151932 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 151945 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 151974 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 151986 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 152441 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1709451884
   [junit4]   2> 152550 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 152561 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 152562 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 152576 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 152580 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 152583 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 152584 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 152586 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 152586 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 152586 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 152587 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data/]
   [junit4]   2> 152587 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@30baae4a
   [junit4]   2> 152587 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data
   [junit4]   2> 152588 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data/index/
   [junit4]   2> 152588 WARN  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 152589 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data/index
   [junit4]   2> 152589 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 152589 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@7ebe36cc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@79ffcc15),segFN=segments_1,generation=1}
   [junit4]   2> 152589 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 152590 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data/
   [junit4]   2> 152590 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 152597 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 152607 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 152607 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 152607 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 152607 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 152607 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 152608 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 152608 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 152608 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 152608 WARN  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 152611 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 152613 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 152614 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 152616 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 152623 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/ping,/admin/logging,/update/json/docs,/update/csv,/get,/admin/mbeans,/admin/plugins,standard,/schema,/update/json,/admin/properties,/update,/admin/threads,/admin/luke,/replication,/config,/admin/file,/admin/system,/admin/segments,/dump
   [junit4]   2> 152624 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 152625 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 152625 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 152626 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 152626 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 152627 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=418857139, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 152627 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@7ebe36cc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@79ffcc15),segFN=segments_1,generation=1}
   [junit4]   2> 152627 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 152627 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5474a724[collection1] main
   [junit4]   2> 152628 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 152632 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 152632 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 152633 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 152633 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 152633 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 152633 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 152633 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 152633 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 152634 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 152635 INFO  (searcherExecutor-479-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5474a724[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 152635 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 152635 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 152635 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 152635 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1522725781174747136
   [junit4]   2> 152637 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1522725781174747136
   [junit4]   2> 152637 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 152638 INFO  (coreLoadExecutor-478-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 152638 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:54888/zke/sh collection:control_collection shard:shard1
   [junit4]   2> 152639 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 152646 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95170361170001926-core_node1-n_0000000000
   [junit4]   2> 152646 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 152649 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 152649 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 152650 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54888/zke/sh/collection1/
   [junit4]   2> 152650 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 152650 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 152650 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54888/zke/sh/collection1/ has no replicas
   [junit4]   2> 152651 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 152652 INFO  (zkCallback-127-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 152657 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 152660 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54888/zke/sh/collection1/ shard1
   [junit4]   2> 152661 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:54888/zke/sh",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 152765 INFO  (zkCallback-127-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 152812 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:54888/zke/sh/collection1/ and leader is http://127.0.0.1:54888/zke/sh/collection1/
   [junit4]   2> 152812 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54888/zke/sh
   [junit4]   2> 152812 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 152812 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 152812 INFO  (coreZkRegister-472-thread-1-processing-c:control_collection x:collection1 r:core_node1 s:shard1 n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 152816 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54888/zke/sh",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "node_name":"127.0.0.1:54888_zke%2Fsh"} current state version: 3
   [junit4]   2> 152816 INFO  (OverseerStateUpdate-95170361170001926-127.0.0.1:54888_zke%2Fsh-n_0000000000) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54888/zke/sh",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "node_name":"127.0.0.1:54888_zke%2Fsh"}
   [junit4]   2> 152920 INFO  (zkCallback-127-thread-1-processing-n:127.0.0.1:54888_zke%2Fsh) [n:127.0.0.1:54888_zke%2Fsh    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 152941 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 152941 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 152943 INFO  (zkCallback-129-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b63e389 name:ZooKeeperConnection Watcher:127.0.0.1:36018/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 152943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 152943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 152943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 152947 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 153316 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/shard-1-001/cores/collection1
   [junit4]   2> 153317 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_7DCEE06F68BF3374-001/shard-1-001
   [junit4]   2> 153317 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 153319 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a1b37e7{/zke/sh,null,AVAILABLE}


[...truncated too long message...]

l.ExecutorUtil$MDCAwareThreadPoolExecutor@613e9592[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 68]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:215)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 2158294 INFO  (TEST-ShardSplitTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@2ff0c2f6{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 2158294 INFO  (TEST-ShardSplitTest.test-seed#[7DCEE06F68BF3374]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5d5ced8a{/,null,UNAVAILABLE}
   [junit4]   2> 2158296 INFO  (TEST-ShardSplitTest.test-seed#[7DCEE06F68BF3374]) [n:127.0.0.1:51725_ c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53719 53719
   [junit4]   2> 2158448 INFO  (Thread-3738) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53719 53719
   [junit4]   2> 2158449 WARN  (Thread-3738) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ShardSplitTest -Dtests.method=test -Dtests.seed=7DCEE06F68BF3374 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ar_LY -Dtests.timezone=Pacific/Apia -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE  418s J1 | ShardSplitTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7DCEE06F68BF3374:F59ADFB5C6435E8C]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:175)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:136)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:825)
   [junit4]    > 	at org.apache.solr.cloud.ShardSplitTest.splitByUniqueKeyTest(ShardSplitTest.java:219)
   [junit4]    > 	at org.apache.solr.cloud.ShardSplitTest.test(ShardSplitTest.java:82)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2158451 INFO  (SUITE-ShardSplitTest-seed#[7DCEE06F68BF3374]-worker) [n:127.0.0.1:51725_ c:collection1 s:shard2 r:core_node4 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_7DCEE06F68BF3374-001
   [junit4]   2> Jan 07, 2016 5:07:54 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {_version_=FSTOrd50, id=PostingsFormat(name=Memory doPackFST= true), n_ti=FST50}, docValues:{}, sim=DefaultSimilarity, locale=ar_LY, timezone=Pacific/Apia
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=1,free=212668280,total=528482304
   [junit4]   2> NOTE: All tests run in this JVM: [TestRawResponseWriter, TestQuerySenderNoQuery, TestRuleBasedAuthorizationPlugin, TestLMJelinekMercerSimilarityFactory, SimplePostToolTest, TestManagedSchemaFieldResource, DistributedIntervalFacetingTest, BlockCacheTest, SoftAutoCommitTest, MBeansHandlerTest, DistributedMLTComponentTest, TestSimpleTrackingShardHandler, ZkCLITest, NotRequiredUniqueKeyTest, TestDistribDocBasedVersion, CollectionsAPIDistributedZkTest, TestSolrQueryParserResource, TestCollapseQParserPlugin, HdfsChaosMonkeySafeLeaderTest, TestDFRSimilarityFactory, DocExpirationUpdateProcessorFactoryTest, DistributedDebugComponentTest, InfoHandlerTest, AddSchemaFieldsUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderTest, MinimalSchemaTest, HighlighterTest, TestSurroundQueryParser, TestConfigSetsAPIExclusivity, ZkSolrClientTest, SharedFSAutoReplicaFailoverUtilsTest, TestSolrXml, CSVRequestHandlerTest, DateRangeFieldTest, LeaderInitiatedRecoveryOnShardRestartTest, PKIAuthenticationIntegrationTest, ConnectionManagerTest, TestFastLRUCache, TestSchemaNameResource, TestManagedSynonymFilterFactory, BlockJoinFacetDistribTest, TestSolrCoreProperties, NumericFieldsTest, TestInitParams, SpellCheckComponentTest, ShardRoutingCustomTest, DistributedQueueTest, TestUseDocValuesAsStored2, HdfsWriteToMultipleCollectionsTest, TestConfigSetImmutable, TestOrdValues, HdfsRecoverLeaseTest, TestRandomRequestDistribution, LoggingHandlerTest, RecoveryAfterSoftCommitTest, SolrCmdDistributorTest, AssignTest, TestSearcherReuse, TestRestoreCore, TermsComponentTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestScoreJoinQPNoScore, SolrXmlInZkTest, TestBinaryResponseWriter, TestTestInjection, HdfsDirectoryFactoryTest, HttpPartitionTest, SolrIndexConfigTest, TestCloudManagedSchemaConcurrent, TestCoreContainer, ConjunctionSolrSpellCheckerTest, IndexBasedSpellCheckerTest, DistanceFunctionTest, SuggestComponentContextFilterQueryTest, TestQueryUtils, TestCopyFieldCollectionResource, TestOverriddenPrefixQueryForCustomFieldType, TestDynamicFieldResource, TestUpdate, SaslZkACLProviderTest, TestDistributedGrouping, TestCloudPivotFacet, TestTrieFacet, TermVectorComponentTest, ChaosMonkeyNothingIsSafeTest, TestQueryTypes, HdfsDirectoryTest, SchemaVersionSpecificBehaviorTest, SortSpecParsingTest, TestSolr4Spatial2, TestRequestForwarding, ClusterStateUpdateTest, LeaderElectionTest, TestHashPartitioner, TestJoin, DistributedTermsComponentTest, TestFiltering, SolrIndexSplitterTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, TestTrie, TestCSVLoader, WordBreakSolrSpellCheckerTest, QueryEqualityTest, TestRemoteStreaming, CacheHeaderTest, LukeRequestHandlerTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, SolrPluginUtilsTest, JSONWriterTest, UniqFieldsUpdateProcessorFactoryTest, PingRequestHandlerTest, MultiTermTest, TestDocSet, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCodecSupport, TestBM25SimilarityFactory, TestJmxMonitoredMap, ResourceLoaderTest, ScriptEngineTest, TestSystemIdResolver, TestSuggestSpellingConverter, DOMUtilTest, TestSolrJ, TestDocumentBuilder, CircularListTest, TestRTGBase, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ActionThrottleTest, AsyncMigrateRouteKeyTest, ConfigSetsAPITest, DistribCursorPagingTest, DistributedVersionInfoTest, OverseerStatusTest, OverseerTaskQueueTest, ReplicationFactorTest, RestartWhileUpdatingTest, SSLMigrationTest, ShardSplitTest]
   [junit4] Completed [515/562 (4!)] on J1 in 418.86s, 1 test, 1 failure <<< FAILURES!

[...truncated 160 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:794: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1000: There were test failures: 562 suites (7 ignored), 2235 tests, 4 failures, 54 ignored (39 assumptions) [seed: 7DCEE06F68BF3374]

Total time: 66 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3911 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3911/

All tests passed

Build Log:
[...truncated 9655 lines...]
    [javac] Compiling 613 source files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/classes/test
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:103: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent(CoreDescriptor.CORE_CONFIG, "solrconfig-tlog.xml");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:104: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.maxBufferedDocs", "100000");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:105: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.ramBufferSizeMB", "100");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:107: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.mergePolicy", "org.apache.lucene.index.TieredMergePolicy");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:108: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.mergeScheduler", "org.apache.lucene.index.ConcurrentMergeScheduler");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:109: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.directoryFactory", (persistIndex ? "solr.StandardDirectoryFactory" : "solr.RAMDirectoryFactory"));
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 6 errors

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:794: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:808: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:822: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1956: Compile failed; see the compiler error output for details.

Total time: 26 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-5.x-Java7 - Build # 3910 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.x-Java7/3910/

All tests passed

Build Log:
[...truncated 9622 lines...]
    [javac] Compiling 613 source files to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build/solr-core/classes/test
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:103: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent(CoreDescriptor.CORE_CONFIG, "solrconfig-tlog.xml");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:104: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.maxBufferedDocs", "100000");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:105: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.ramBufferSizeMB", "100");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:107: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.mergePolicy", "org.apache.lucene.index.TieredMergePolicy");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:108: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.tests.mergeScheduler", "org.apache.lucene.index.ConcurrentMergeScheduler");
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/core/src/test/org/apache/solr/cloud/TestMiniSolrCloudCluster.java:109: error: cannot find symbol
    [javac]     collectionProperties.putIfAbsent("solr.directoryFactory", (persistIndex ? "solr.StandardDirectoryFactory" : "solr.RAMDirectoryFactory"));
    [javac]                         ^
    [javac]   symbol:   method putIfAbsent(String,String)
    [javac]   location: variable collectionProperties of type Map<String,String>
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 6 errors

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:794: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:808: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:822: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.x-Java7/lucene/common-build.xml:1956: Compile failed; see the compiler error output for details.

Total time: 26 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any