You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/08/31 11:29:43 UTC

[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 781 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/781/

1 tests failed.
REGRESSION:  org.apache.lucene.collation.TestCollationDocValuesField.testRanges

Error Message:
expected:<false> but was:<true>

Stack Trace:
java.lang.AssertionError: expected:<false> but was:<true>
	at __randomizedtesting.SeedInfo.seed([F96E1F95981C9AB3:24D76E5AF75ECC55]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.collation.TestCollationDocValuesField.doTestRanges(TestCollationDocValuesField.java:126)
	at org.apache.lucene.collation.TestCollationDocValuesField.testRanges(TestCollationDocValuesField.java:110)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 2644 lines...]
   [junit4] Suite: org.apache.lucene.collation.TestCollationDocValuesField
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCollationDocValuesField -Dtests.method=testRanges -Dtests.seed=F96E1F95981C9AB3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=et_EE -Dtests.timezone=Europe/Istanbul -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 5.90s J1 | TestCollationDocValuesField.testRanges <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<false> but was:<true>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F96E1F95981C9AB3:24D76E5AF75ECC55]:0)
   [junit4]    > 	at org.apache.lucene.collation.TestCollationDocValuesField.doTestRanges(TestCollationDocValuesField.java:126)
   [junit4]    > 	at org.apache.lucene.collation.TestCollationDocValuesField.testRanges(TestCollationDocValuesField.java:110)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/common/test/J1/temp/lucene.collation.TestCollationDocValuesField_F96E1F95981C9AB3-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {field=PostingsFormat(name=LuceneFixedGap)}, docValues:{collated=DocValuesFormat(name=Lucene50)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=et_EE, timezone=Europe/Istanbul
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=308404992,total=343932928
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollationDocValuesField]
   [junit4] Completed [15/276] on J1 in 7.11s, 2 tests, 1 failure <<< FAILURES!

[...truncated 791 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:471: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:2162: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/analysis/build.xml:106: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/analysis/build.xml:38: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/module-build.xml:58: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 276 suites, 1413 tests, 1 failure, 1 ignored

Total time: 72 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 792 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/792/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=2704, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=2704, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:47130, https://127.0.0.1:60146, https://127.0.0.1:36655, https://127.0.0.1:41275, https://127.0.0.1:57179]
	at __randomizedtesting.SeedInfo.seed([C906CE0EF902FA4F]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:47130, https://127.0.0.1:60146, https://127.0.0.1:36655, https://127.0.0.1:41275, https://127.0.0.1:57179]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:60146: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 5 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=73357, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=73357, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44465/vt_mcn/re: Could not find collection : awholynewstresscollection_collection5_1
	at __randomizedtesting.SeedInfo.seed([C906CE0EF902FA4F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 9963 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/init-core-data-001
   [junit4]   2> 415318 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[C906CE0EF902FA4F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 415318 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[C906CE0EF902FA4F]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 415320 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 415330 INFO  (Thread-1017) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 415330 INFO  (Thread-1017) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 415421 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkTestServer start zk server on port:41643
   [junit4]   2> 415421 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415422 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415429 INFO  (zkCallback-250-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@72b433b6 name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415429 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415429 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415430 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 415434 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415450 INFO  (zkCallback-251-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5356aa17 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 415454 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 415457 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 415458 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 415459 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 415460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 415463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 415463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 415465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415467 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 415468 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 415470 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 415470 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 415472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 415472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 415473 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 415474 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 415475 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 415475 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 415477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415478 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 415479 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 415481 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 415481 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 415484 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415484 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415486 INFO  (zkCallback-252-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d9f529d name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415486 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415487 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415490 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415491 INFO  (zkCallback-253-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c8d93fe name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 415494 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415502 INFO  (zkCallback-254-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ff7a1e name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415502 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415502 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415503 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 415503 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 415508 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 415508 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 415511 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 415511 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 415518 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415519 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 415521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 415535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 415535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 415537 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 415537 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 415539 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 415539 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 415540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 415544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 415545 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 415545 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 415547 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 415547 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 416021 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1
   [junit4]   2> 416023 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 416027 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@470eb728{/,null,AVAILABLE}
   [junit4]   2> 416048 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@25b9bd6{SSL-http/1.1}{127.0.0.1:36655}
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server Started @419249ms
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/tempDir-001/control/data, hostContext=/, hostPort=36655, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores}
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/'
   [junit4]   2> 416065 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 416066 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 416070 INFO  (zkCallback-255-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a2d1bf5 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 416070 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 416070 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 416073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 416073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/solr.xml
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer New CoreContainer 1967112450
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/]
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/lib
   [junit4]   2> 416083 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/lib).
   [junit4]   2> 416092 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 416099 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 416101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 416101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 416101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41643/solr
   [junit4]   2> 416102 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 416102 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 416110 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 416116 INFO  (zkCallback-257-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d1a90ed name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 416117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 416118 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 416122 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 416130 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76233f4f name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 416130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 416132 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 416134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 416140 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 416143 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 416154 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 416157 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 416158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 416159 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 416160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 416166 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36655_
   [junit4]   2> 416166 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:36655_
   [junit4]   2> 416168 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 416169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 416170 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 416171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94508122102693895-127.0.0.1:36655_-n_0000000000
   [junit4]   2> 416171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36655_
   [junit4]   2> 416171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 416172 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer Overseer (id=94508122102693895-127.0.0.1:36655_-n_0000000000) starting
   [junit4]   2> 416174 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 416193 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 416203 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 416203 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 416207 INFO  (OverseerCollectionConfigSetProcessor-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 416219 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 416233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 416233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 416242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores
   [junit4]   2> 416245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 416245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/
   [junit4]   2> 416246 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 416258 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 416258 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 416259 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 416259 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 416264 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 416264 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 416265 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 416266 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 416267 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 416268 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 416269 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417265 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 417265 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 417266 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 417266 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 417267 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 417267 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/'
   [junit4]   2> 417284 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 417297 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 417301 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 417310 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 417311 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 417316 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 417424 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 417447 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 417448 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 417463 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 417470 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 417473 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 417474 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 417474 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 417474 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 417475 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 417475 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 417477 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 417477 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 417482 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 417486 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 417486 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@716ca58f
   [junit4]   2> 417487 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data
   [junit4]   2> 417487 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/index/
   [junit4]   2> 417487 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 417487 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/index
   [junit4]   2> 417488 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1c8952c
   [junit4]   2> 417498 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2b54f906 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6fc102),segFN=segments_1,generation=1}
   [junit4]   2> 417498 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 417510 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/
   [junit4]   2> 417510 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 417512 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 417513 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 417516 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 417516 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 417516 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 417519 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417520 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417521 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417522 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417533 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 417533 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 417551 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 417551 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 417552 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 417552 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 417552 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=90.6552734375, floorSegmentMB=1.8486328125, forceMergeDeletesPctAllowed=15.77473054312975, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 417553 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2b54f906 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6fc102),segFN=segments_1,generation=1}
   [junit4]   2> 417553 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 417553 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@164cd192[collection1] main
   [junit4]   2> 417554 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 417556 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 417556 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 417556 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1512129955968843776
   [junit4]   2> 417560 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1512129955968843776
   [junit4]   2> 417563 INFO  (searcherExecutor-1085-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@164cd192[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 417564 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 417565 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 417577 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:36655 collection:control_collection shard:shard1
   [junit4]   2> 417578 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 417583 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94508122102693895-core_node1-n_0000000000
   [junit4]   2> 417584 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36655/collection1/
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 417587 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:36655/collection1/ has no replicas
   [junit4]   2> 417587 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36655/collection1/ shard1
   [junit4]   2> 417587 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 417590 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 417592 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 417596 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 417699 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417699 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417748 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:36655/collection1/ and leader is https://127.0.0.1:36655/collection1/
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:36655
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 417751 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 417752 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 417770 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 417784 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 417788 INFO  (zkCallback-260-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54ae017b name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 417789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 417789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 417789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 417792 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 417793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 417793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 417793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 417795 INFO  (zkCallback-261-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5162c74f name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 417795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 417796 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 417810 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 417810 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 417814 INFO  (zkCallback-260-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417822 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417822 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417930 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 418201 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1
   [junit4]   2> 418202 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001
   [junit4]   2> 418203 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 418207 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18eb941b{/,null,AVAILABLE}
   [junit4]   2> 418216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1c4e353f{SSL-http/1.1}{127.0.0.1:47130}
   [junit4]   2> 418216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server Started @421417ms
   [junit4]   2> 418216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=47130, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores}
   [junit4]   2> 418217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 418217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/'
   [junit4]   2> 418239 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 418239 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 418247 INFO  (zkCallback-262-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a39c391 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 418247 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 418247 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 418252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 418252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/solr.xml
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer New CoreContainer 332013229
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/]
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/lib
   [junit4]   2> 418259 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/lib).
   [junit4]   2> 418270 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 418273 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41643/solr
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 418292 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 418304 INFO  (zkCallback-264-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46bd5901 name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 418305 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 418306 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 418331 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 418350 INFO  (zkCallback-265-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5411a7c8 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 418350 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 418356 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 419361 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47130_
   [junit4]   2> 419361 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47130_
   [junit4]   2> 419362 INFO  (zkCallback-265-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419363 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419363 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419364 INFO  (zkCallback-260-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419364 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 419365 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94508122102693900-127.0.0.1:47130_-n_0000000001
   [junit4]   2> 419365 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94508122102693895-127.0.0.1:36655_-n_0000000000 to know if I could be the leader
   [junit4]   2> 419383 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 419383 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 419384 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores
   [junit4]   2> 419385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 419385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1/
   [junit4]   2> 419385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 419388 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 419388 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 419390 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 419390 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 419390 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:47130",
   [junit4]   2>   "node_name":"127.0.0.1:47130_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 419391 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0 
   [junit4]   2> 419391 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 419391 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:47130",
   [junit4]   2>   "node_name":"127.0.0.1:47130_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 419391 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 419391 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 419398 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 419398 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.

[...truncated too long message...]

62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4082009 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[C906CE0EF902FA4F]-worker) [n:127.0.0.1:44465_vt_mcn%2Fre c:addReplicaColl s:shard1 r:core_node7 x:propertyDotName] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 12, 2015 2:39:27 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=FST50, _version_=Lucene50(blocksize=128), multiDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), intDefault=Lucene50(blocksize=128), a_i1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=FST50, range_facet_i_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=PostingsFormat(name=Direct), range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Lucene50), timestamp=DocValuesFormat(name=Lucene50)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_KW, timezone=Canada/Atlantic
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=133740264,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [DateFieldTest, SmileWriterTest, SparseHLLTest, ResourceLoaderTest, AlternateDirectoryTest, RankQueryTest, RollingRestartTest, CdcrReplicationDistributedZkTest, DeleteShardTest, EnumFieldTest, TestIntervalFaceting, ConnectionManagerTest, JavabinLoaderTest, TestSolrQueryParserDefaultOperatorResource, TestCloudSchemaless, HighlighterMaxOffsetTest, TestSchemaSimilarityResource, BasicZkTest, RequiredFieldsTest, TestSchemaResource, SpatialHeatmapFacetsTest, TestDistributedSearch, ChangedSchemaMergeTest, DistributedFacetPivotLargeTest, DistributedIntervalFacetingTest, TestLMDirichletSimilarityFactory, InfoHandlerTest, JSONWriterTest, TestLuceneMatchVersion, TestBlobHandler, TestDocumentBuilder, DistribJoinFromCollectionTest, TestSolrJ, TestExceedMaxTermLength, SolrRequestParserTest, DocumentAnalysisRequestHandlerTest, TestJoin, AnalysisAfterCoreReloadTest, CdcrReplicationHandlerTest, OpenExchangeRatesOrgProviderTest, TestFaceting, TestChildDocTransformer, ReplicationFactorTest, TestRealTimeGet, FileBasedSpellCheckerTest, ActionThrottleTest, TestRandomDVFaceting, SaslZkACLProviderTest, CollectionStateFormat2Test, TestPseudoReturnFields, TestAnalyzedSuggestions, TestNoOpRegenerator, UUIDUpdateProcessorFallbackTest, PeerSyncTest, BlockDirectoryTest, DistributedSuggestComponentTest, TestStandardQParsers, TestDynamicFieldResource, RequestLoggingTest, TestSimpleQParserPlugin, CursorPagingTest, TestFoldingMultitermQuery, TestConfigSetsAPIZkFailure, OverseerRolesTest, EchoParamsTest, TestInitQParser, TestAtomicUpdateErrorCases, TestPKIAuthenticationPlugin, OutputWriterTest, TestLazyCores, CollectionTooManyReplicasTest, DateMathParserTest, CurrencyFieldOpenExchangeTest, DateRangeFieldTest, TestSolrConfigHandlerConcurrent, SOLR749Test, RemoteQueryErrorTest, VersionInfoTest, SolrTestCaseJ4Test, TimeZoneUtilsTest, TestRandomMergePolicy, LeaderInitiatedRecoveryOnCommitTest, TestReloadAndDeleteDocs, OverseerStatusTest, XsltUpdateRequestHandlerTest, DistributedVersionInfoTest, TestSchemaNameResource, QueryElevationComponentTest, ExitableDirectoryReaderTest, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestZkChroot, ShardRoutingCustomTest, AutoCommitTest, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestStressReorder, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, BadIndexSchemaTest, TestFunctionQuery, TestBadConfig, TestIndexSearcher, HighlighterTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, TestStressLucene, PolyFieldTest, WordBreakSolrSpellCheckerTest, QueryEqualityTest, TestRemoteStreaming, CacheHeaderTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, TestWriterPerf, TestOmitPositions, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, FastVectorHighlighterTest, LoggingHandlerTest, IndexSchemaTest, TestCollationField, MBeansHandlerTest, JsonLoaderTest, PingRequestHandlerTest, MultiTermTest, TestDocSet, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, ExternalFileFieldSortTest, DirectSolrConnectionTest, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, TestPerFieldSimilarity, TestBM25SimilarityFactory, ScriptEngineTest, PreAnalyzedFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestUtils, SliceStateTest, FileUtilsTest, DistributedMLTComponentTest, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, AssignTest, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CollectionReloadTest, DistributedQueueTest, HttpPartitionTest, TestConfigSetsAPI, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [540/545] on J0 in 835.99s, 1 test, 1 error <<< FAILURES!

[...truncated 27 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 545 suites, 2144 tests, 2 errors, 29 ignored (17 assumptions)

Total time: 184 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 791 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/791/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=12534, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=12534, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38890/hlt/t, http://127.0.0.1:48420/hlt/t, http://127.0.0.1:48234/hlt/t, http://127.0.0.1:43463/hlt/t, http://127.0.0.1:35967/hlt/t]
	at __randomizedtesting.SeedInfo.seed([D304BAF25EEA1E21]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38890/hlt/t, http://127.0.0.1:48420/hlt/t, http://127.0.0.1:48234/hlt/t, http://127.0.0.1:43463/hlt/t, http://127.0.0.1:35967/hlt/t]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:48234/hlt/t: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 5 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=32471, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=32471, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45492/co/zf: Could not find collection : awholynewstresscollection_collection4_0
	at __randomizedtesting.SeedInfo.seed([D304BAF25EEA1E21]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10342 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/init-core-data-001
   [junit4]   2> 1232711 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D304BAF25EEA1E21]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1232712 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D304BAF25EEA1E21]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /hlt/t
   [junit4]   2> 1232714 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1232714 INFO  (Thread-9127) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1232714 INFO  (Thread-9127) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1232814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkTestServer start zk server on port:52781
   [junit4]   2> 1232814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232815 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232818 INFO  (zkCallback-598-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@313967f3 name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232818 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232819 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232819 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1232822 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232822 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232830 INFO  (zkCallback-599-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@85aeb3a name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1232832 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1232834 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1232835 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1232836 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1232837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1232839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1232839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1232841 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232841 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232842 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1232843 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1232844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1232844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1232846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1232846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1232847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1232847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1232849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1232849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1232850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232851 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1232852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1232854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1232854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1232856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232858 INFO  (zkCallback-600-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@345be015 name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1232860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232861 INFO  (zkCallback-601-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d2f4d61 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232861 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232861 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232862 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1232862 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1232864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1232864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1232866 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1232866 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1232868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232869 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1232870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1232871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1232872 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1232873 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1232873 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1232875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1232875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1232877 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232877 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1232879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1232880 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1232881 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1232882 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1232882 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1233186 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1
   [junit4]   2> 1233187 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1233189 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b212dc7{/hlt/t,null,AVAILABLE}
   [junit4]   2> 1233194 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6fd264c8{HTTP/1.1}{127.0.0.1:48234}
   [junit4]   2> 1233194 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server Started @1236500ms
   [junit4]   2> 1233195 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/tempDir-001/control/data, hostContext=/hlt/t, hostPort=48234, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores}
   [junit4]   2> 1233195 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1233195 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/'
   [junit4]   2> 1233211 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1233212 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233213 INFO  (zkCallback-602-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6635284e name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233214 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1233214 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1233215 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1233215 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/solr.xml
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer New CoreContainer 1376837303
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/]
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/lib
   [junit4]   2> 1233221 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/lib).
   [junit4]   2> 1233228 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52781/solr
   [junit4]   2> 1233230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1233230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1233230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233231 INFO  (zkCallback-604-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7906dfab name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233232 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1233233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1233234 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233235 INFO  (zkCallback-605-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b74d49e name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1233236 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1233238 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1233240 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1233242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1233244 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1233246 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1233248 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1233249 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1233250 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1233251 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48234_hlt%2Ft
   [junit4]   2> 1233251 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48234_hlt%2Ft
   [junit4]   2> 1233253 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1233254 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1233255 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1233256 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000
   [junit4]   2> 1233256 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48234_hlt%2Ft
   [junit4]   2> 1233257 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1233258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer Overseer (id=94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) starting
   [junit4]   2> 1233260 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1233266 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1233266 INFO  (OverseerCollectionConfigSetProcessor-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1233267 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1233267 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1233281 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1233282 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1233282 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores
   [junit4]   2> 1233283 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1233283 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/
   [junit4]   2> 1233284 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1233285 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1233285 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1233285 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1233285 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1233287 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1233287 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1233287 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1233288 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1233288 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1233290 INFO  (zkCallback-605-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234288 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1234288 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1234289 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1234289 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1234290 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1234290 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/'
   [junit4]   2> 1234305 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1234310 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1234323 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1234330 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1234331 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1234336 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1234416 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1234422 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1234423 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1234432 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1234435 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1234437 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1234438 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1234438 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1234438 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1234439 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1234439 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1234440 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1234440 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1234440 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1234441 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1234441 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f950df
   [junit4]   2> 1234441 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data
   [junit4]   2> 1234442 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1234442 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1234442 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/index
   [junit4]   2> 1234442 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1234443 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@576cef24 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2ab92475),segFN=segments_1,generation=1}
   [junit4]   2> 1234443 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1234444 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/
   [junit4]   2> 1234444 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1234451 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234452 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234453 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234454 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234457 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1234457 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1234458 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1234458 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1234466 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1234466 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=598478639, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@576cef24 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2ab92475),segFN=segments_1,generation=1}
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@69b4d74c[collection1] main
   [junit4]   2> 1234468 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1234468 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1234468 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1234469 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1234469 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1234469 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1234471 INFO  (searcherExecutor-1617-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@69b4d74c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511961473387069440
   [junit4]   2> 1234474 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1511961473387069440
   [junit4]   2> 1234474 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1234474 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1234475 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:48234/hlt/t collection:control_collection shard:shard1
   [junit4]   2> 1234476 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1234480 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94497591971676166-core_node1-n_0000000000
   [junit4]   2> 1234481 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48234/hlt/t/collection1/
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1234483 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48234/hlt/t/collection1/ has no replicas
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48234/hlt/t/collection1/ shard1
   [junit4]   2> 1234484 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1234486 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1234489 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1234591 INFO  (zkCallback-605-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234639 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:48234/hlt/t/collection1/ and leader is http://127.0.0.1:48234/hlt/t/collection1/
   [junit4]   2> 1234639 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48234/hlt/t
   [junit4]   2> 1234640 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1234640 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1234640 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1234642 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1234643 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1234746 INFO  (zkCallback-605-thread-2-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1234788 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1234789 INFO  (zkCallback-607-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74bd4809 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1234789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1234790 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1234790 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1234794 INFO  (zkCallback-608-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d2924c1 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1234795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1234795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1234797 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x14fb90f299a0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1234797 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 1234798 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1234900 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1235107 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores/collection1
   [junit4]   2> 1235108 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001
   [junit4]   2> 1235108 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1235110 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56d30f0e{/hlt/t,null,AVAILABLE}
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6778ed9b{HTTP/1.1}{127.0.0.1:38890}
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server Started @1238417ms
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/hlt/t, hostPort=38890, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores}
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1235112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/'
   [junit4]   2> 1235127 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1235127 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235129 INFO  (zkCallback-609-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bea2446 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235129 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1235129 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1235130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1235130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/solr.xml
   [junit4]   2> 1235135 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores
   [junit4]   2> 1235135 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer New CoreContainer 2037587153
   [junit4]   2> 1235136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/]
   [junit4]   2> 1235136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/lib
   [junit4]   2> 1235136 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/lib).
   [junit4]   2> 1235143 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1235144 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52781/solr
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1235146 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235150 INFO  (zkCallback-611-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@62ab0eef name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1235151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1235154 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235155 INFO  (zkCallback-612-thread-1-processing-n:127.0.0.1:38890_hlt%2Ft) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@794bbf7e name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235155 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1235164 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1236170 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38890_hlt%2Ft
   [junit4]   2> 1236171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38890_hlt%2Ft
   [junit4]   2> 1236173 INFO  (zkCallback-607-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236173 INFO  (zkCallback-605-thread-2-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236173 INFO  (zkCallback-612-thread-1-processing-n:127.0.0.1:38890_hlt%2Ft) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236175 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1236176 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94497591971676171-127.0.0.1:38890_hlt%2Ft-n_0000000001
   [junit4]   2> 1236177 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000 to know if I could be the leader
   [junit4]   2> 1236185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1236185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1236186 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores
   [junit4]   2> 1236187 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-t

[...truncated too long message...]

[junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 5490216 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D304BAF25EEA1E21]-worker) [n:127.0.0.1:45492_co%2Fzf c:addReplicaColl s:shard1 r:core_node1 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 10, 2015 6:11:21 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=FSTOrd50, _version_=Lucene50(blocksize=128), multiDefault=FST50, a_t=Lucene50(blocksize=128), intDefault=Lucene50(blocksize=128), a_i1=Lucene50(blocksize=128), id=FSTOrd50, range_facet_i_dv=Lucene50(blocksize=128), text=PostingsFormat(name=Asserting), range_facet_l=Lucene50(blocksize=128), timestamp=Lucene50(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Lucene50), timestamp=DocValuesFormat(name=Lucene50)}, sim=DefaultSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Africa/Harare
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=186056512,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [SolrInfoMBeanTest, ExplicitHLLTest, BJQParserTest, CSVRequestHandlerTest, TestMaxScoreQueryParser, TestStressUserVersions, VMParamsZkACLAndCredentialsProvidersTest, LeaderFailoverAfterPartitionTest, BitVectorTest, TestSolrQueryParserResource, TestNamedUpdateProcessors, DistanceFunctionTest, OpenCloseCoreStressTest, SolrPluginUtilsTest, TestSQLHandler, SpatialFilterTest, DistanceUnitsTest, TestPartialUpdateDeduplication, TestCloudManagedSchema, ZkStateReaderTest, TestOverriddenPrefixQueryForCustomFieldType, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DocExpirationUpdateProcessorFactoryTest, FastVectorHighlighterTest, TestBlendedInfixSuggestions, TestCustomDocTransformer, HdfsRecoveryZkTest, TestCustomSort, TestFieldTypeResource, TestFastOutputStream, HdfsLockFactoryTest, SolrCmdDistributorTest, DocValuesTest, HLLSerializationTest, DistributedQueueTest, TestAuthenticationFramework, ChaosMonkeyNothingIsSafeTest, TestSchemaManager, TestJettySolrRunner, TestCoreContainer, TestConfigSets, TestFileDictionaryLookup, SSLMigrationTest, TestRestoreCore, TestManagedSchemaFieldTypeResource, TestTrie, TestCrossCoreJoin, URLClassifyProcessorTest, TestDistributedGrouping, TermsComponentTest, TestUtils, TestUniqueKeyFieldResource, CollectionsAPIDistributedZkTest, TestSuggestSpellingConverter, NumericFieldsTest, MultiTermTest, TestManagedSchema, TestWordDelimiterFilterFactory, TestBM25SimilarityFactory, ClusterStateUpdateTest, TestOrdValues, TestReloadDeadlock, TestTolerantSearch, LoggingHandlerTest, SolrCloudExampleTest, PreAnalyzedUpdateProcessorTest, TestCloudPivotFacet, TestReqParamsAPI, UpdateRequestProcessorFactoryTest, TestDFRSimilarityFactory, TestDistribDocBasedVersion, TestCopyFieldCollectionResource, SolrIndexConfigTest, MinimalSchemaTest, SolrIndexSplitterTest, TriLevelCompositeIdRoutingTest, TestSolrDeletionPolicy2, BasicFunctionalityTest, TestMacros, SliceStateTest, SimpleMLTQParserTest, HighlighterTest, DocumentBuilderTest, SharedFSAutoReplicaFailoverTest, DistributedFacetPivotWhiteBoxTest, TestBinaryResponseWriter, TestDefaultSearchFieldResource, TestRandomFaceting, TermVectorComponentDistributedTest, TestJoin, TestStressVersions, TestRangeQuery, SolrCoreTest, QueryElevationComponentTest, TestFunctionQuery, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SolrRequestParserTest, SuggesterTSTTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, TestUpdate, StatelessScriptUpdateProcessorFactoryTest, IndexBasedSpellCheckerTest, TestQueryUtils, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, RegexBoostProcessorTest, TestCollationField, JSONWriterTest, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, TestLFUCache, CdcrReplicationDistributedZkTest, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, TestShortCircuitedRequests, HdfsBasicDistributedZk2Test, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [545/545] on J1 in 2158.23s, 1 test, 1 error <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 545 suites, 2143 tests, 2 errors, 29 ignored (17 assumptions)

Total time: 216 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 790 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/790/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.DistribJoinFromCollectionTest.test

Error Message:
 Expected: not "1.0"      got: "1.0" 

Stack Trace:
java.lang.AssertionError: 
Expected: not "1.0"
     got: "1.0"

	at __randomizedtesting.SeedInfo.seed([AAFB6F0BC146A2FD:22AF50D16FBACF05]:0)
	at org.junit.Assert.assertThat(Assert.java:780)
	at org.junit.Assert.assertThat(Assert.java:738)
	at org.apache.solr.cloud.DistribJoinFromCollectionTest.assertScore(DistribJoinFromCollectionTest.java:170)
	at org.apache.solr.cloud.DistribJoinFromCollectionTest.testJoins(DistribJoinFromCollectionTest.java:132)
	at org.apache.solr.cloud.DistribJoinFromCollectionTest.test(DistribJoinFromCollectionTest.java:100)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=1649, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1649, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36605/_io/tv: collection already exists: awholynewstresscollection_collection5_3
	at __randomizedtesting.SeedInfo.seed([AAFB6F0BC146A2FD]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=20492, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=20492, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45331/_dnu/ah: Could not find collection : awholynewstresscollection_collection5_2
	at __randomizedtesting.SeedInfo.seed([AAFB6F0BC146A2FD]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 9986 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/init-core-data-001
   [junit4]   2> 125508 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[AAFB6F0BC146A2FD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 125508 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[AAFB6F0BC146A2FD]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_io/tv
   [junit4]   2> 125518 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 125531 INFO  (Thread-584) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 125531 INFO  (Thread-584) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 125631 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ZkTestServer start zk server on port:38691
   [junit4]   2> 125631 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 125648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 125659 INFO  (zkCallback-182-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@62d8f189 name:ZooKeeperConnection Watcher:127.0.0.1:38691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 125659 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 125660 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 125660 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 125669 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 125696 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 125708 INFO  (zkCallback-183-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a28f54a name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 125708 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 125709 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 125709 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 125711 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 125712 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 125713 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 125714 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 125714 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 125716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 125717 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 125718 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 125718 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 125722 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 125722 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 125724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 125724 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 125725 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 125725 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 125726 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 125727 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 125728 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 125728 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 125729 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 125730 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 125731 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 125731 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 125732 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 125733 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 126183 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1
   [junit4]   2> 126185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 126203 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d88cf05{/_io/tv,null,AVAILABLE}
   [junit4]   2> 126205 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2ff0102f{HTTP/1.1}{127.0.0.1:33752}
   [junit4]   2> 126206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.Server Started @129386ms
   [junit4]   2> 126206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/tempDir-001/control/data, hostContext=/_io/tv, hostPort=33752, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores}
   [junit4]   2> 126206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 126206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/'
   [junit4]   2> 126224 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 126233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 126234 INFO  (zkCallback-184-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@64a549f8 name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 126234 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 126235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 126236 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 126236 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/solr.xml
   [junit4]   2> 126241 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores
   [junit4]   2> 126242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoreContainer New CoreContainer 1399687175
   [junit4]   2> 126242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/]
   [junit4]   2> 126242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/lib
   [junit4]   2> 126242 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/lib).
   [junit4]   2> 126260 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 126262 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 126262 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 126262 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 126262 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38691/solr
   [junit4]   2> 126263 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 126263 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 126264 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 126278 INFO  (zkCallback-186-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@34acd67a name:ZooKeeperConnection Watcher:127.0.0.1:38691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 126279 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 126279 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 126306 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 126307 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@692be441 name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 126307 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 126309 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 126311 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 126315 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 126318 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 126320 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 126323 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 126324 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 126326 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 126327 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 126328 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33752__io%2Ftv
   [junit4]   2> 126329 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33752__io%2Ftv
   [junit4]   2> 126330 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 126332 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 126333 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 126333 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000
   [junit4]   2> 126334 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33752__io%2Ftv
   [junit4]   2> 126334 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 126337 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer Overseer (id=94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) starting
   [junit4]   2> 126339 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 126347 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 126348 INFO  (OverseerCollectionConfigSetProcessor-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 126349 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 126349 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 126355 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 126383 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 126384 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 126384 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores
   [junit4]   2> 126385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 126385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/
   [junit4]   2> 126385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 126391 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 126391 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 126392 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 126392 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 126394 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 126395 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:33752/_io/tv",
   [junit4]   2>   "node_name":"127.0.0.1:33752__io%2Ftv",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 126397 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:33752/_io/tv",
   [junit4]   2>   "node_name":"127.0.0.1:33752__io%2Ftv",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 126397 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 126399 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 126401 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 126401 INFO  (zkCallback-187-thread-2-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 127395 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 127395 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 127395 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 127395 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 127396 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 127396 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/'
   [junit4]   2> 127420 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 127431 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 127435 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 127442 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 127443 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 127465 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 127556 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 127565 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 127566 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 127595 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 127597 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 127599 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 127600 WARN  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 127601 WARN  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 127601 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 127602 WARN  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 127602 WARN  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 127604 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 127604 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 127604 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 127604 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 127604 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b6fa57a
   [junit4]   2> 127605 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/data
   [junit4]   2> 127605 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/data/index/
   [junit4]   2> 127605 WARN  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 127606 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/data/index
   [junit4]   2> 127606 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=8, maxMergedSegmentMB=92.2255859375, floorSegmentMB=2.0126953125, forceMergeDeletesPctAllowed=13.142628610524959, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 127611 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@289889a9),segFN=segments_1,generation=1}
   [junit4]   2> 127612 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 127613 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/data/
   [junit4]   2> 127614 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 127622 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 127622 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 127623 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 127623 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 127623 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 127623 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 127624 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 127624 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 127624 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 127642 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 127643 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 127644 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 127645 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 127649 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 127650 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 127650 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 127651 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 127651 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 127652 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 127652 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=70.0029296875, floorSegmentMB=0.3349609375, forceMergeDeletesPctAllowed=10.432124189999241, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 127654 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@289889a9),segFN=segments_1,generation=1}
   [junit4]   2> 127654 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 127654 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@52ebb3fc[collection1] main
   [junit4]   2> 127654 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 127655 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 127655 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 127656 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 127656 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 127656 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 127658 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 127658 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 127658 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 127658 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 127659 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 127659 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 127659 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 127659 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511846897722064896
   [junit4]   2> 127661 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1511846897722064896
   [junit4]   2> 127661 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 127661 INFO  (searcherExecutor-423-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@52ebb3fc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 127665 INFO  (coreLoadExecutor-422-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 127666 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:33752/_io/tv collection:control_collection shard:shard1
   [junit4]   2> 127667 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 127681 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94490430969217028-core_node1-n_0000000000
   [junit4]   2> 127682 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 127685 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 127685 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 127686 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33752/_io/tv/collection1/
   [junit4]   2> 127686 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 127686 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:33752/_io/tv/collection1/ has no replicas
   [junit4]   2> 127686 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33752/_io/tv/collection1/ shard1
   [junit4]   2> 127689 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 127693 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 127706 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 127718 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:33752/_io/tv",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 127820 INFO  (zkCallback-187-thread-2-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 127821 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 127859 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:33752/_io/tv/collection1/ and leader is http://127.0.0.1:33752/_io/tv/collection1/
   [junit4]   2> 127859 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33752/_io/tv
   [junit4]   2> 127859 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 127860 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 127860 INFO  (coreZkRegister-416-thread-1-processing-n:127.0.0.1:33752__io%2Ftv x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33752__io%2Ftv c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 127861 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:33752/_io/tv",
   [junit4]   2>   "node_name":"127.0.0.1:33752__io%2Ftv",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 127862 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:33752/_io/tv",
   [junit4]   2>   "node_name":"127.0.0.1:33752__io%2Ftv",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 127894 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 127912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 127925 INFO  (zkCallback-189-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a3a7150 name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 127926 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 127926 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 127926 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 127931 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 127931 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 127931 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 127941 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 127943 INFO  (zkCallback-190-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1626e664 name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 127943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 127943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 127945 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 127946 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 127946 INFO  (zkCallback-189-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 127946 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 127947 INFO  (zkCallback-187-thread-2-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 128053 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 128801 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores/collection1
   [junit4]   2> 128803 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001
   [junit4]   2> 128807 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 128829 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1cc52219{/_io/tv,null,AVAILABLE}
   [junit4]   2> 128830 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.ServerConnector Started ServerConnector@54575593{HTTP/1.1}{127.0.0.1:56119}
   [junit4]   2> 128830 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.e.j.s.Server Started @132011ms
   [junit4]   2> 128830 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_io/tv, hostPort=56119, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores}
   [junit4]   2> 128831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 128832 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/'
   [junit4]   2> 128879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 128893 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 128902 INFO  (zkCallback-191-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5325ebc1 name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 128902 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 128902 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 128903 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 128904 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/solr.xml
   [junit4]   2> 128909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores
   [junit4]   2> 128909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoreContainer New CoreContainer 15035131
   [junit4]   2> 128909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/]
   [junit4]   2> 128909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/lib
   [junit4]   2> 128909 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/lib).
   [junit4]   2> 128928 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 128930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 128930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 128930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 128930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38691/solr
   [junit4]   2> 128930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 128931 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 128931 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 128934 INFO  (zkCallback-193-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@41f8ea37 name:ZooKeeperConnection Watcher:127.0.0.1:38691 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 128935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 128935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 128939 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 128943 INFO  (zkCallback-194-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3adacb99 name:ZooKeeperConnection Watcher:127.0.0.1:38691/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 128943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 128948 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 129953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56119__io%2Ftv
   [junit4]   2> 129953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56119__io%2Ftv
   [junit4]   2> 129954 INFO  (zkCallback-189-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 129955 INFO  (zkCallback-194-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 129955 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 129955 INFO  (zkCallback-187-thread-2-processing-n:127.0.0.1:33752__io%2Ftv) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 129958 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 129959 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94490430969217033-127.0.0.1:56119__io%2Ftv-n_0000000001
   [junit4]   2> 129960 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000 to know if I could be the leader
   [junit4]   2> 129979 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 129979 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 129980 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores
   [junit4]   2> 129981 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 129981 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_AAFB6F0BC146A2FD-001/shard-1-001/cores/collection1/
   [junit4]   2> 129981 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 129984 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 129991 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 129991 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[AAFB6F0BC146A2FD]) [n:127.0.0.1:56119__io%2Ftv    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 129991 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 129994 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56119/_io/tv",
   [junit4]   2>   "node_name":"127.0.0.1:56119__io%2Ftv",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 129994 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56119/_io/tv",
   [junit4]   2>   "node_name":"127.0.0.1:56119__io%2Ftv",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 129994 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 129995 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 129997 INFO  (OverseerStateUpdate-94490430969217028-127.0.0.1:33752__io%2Ftv-n_0000000000) [n:127.0.0.1:33752__io%2Ftv    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 130001 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 130001 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 130002 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 1 
   [junit4]   2> 130002 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 130002 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 130002 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 130003 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 130003 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0.0.1:56119__io%2Ftv c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
   [junit4]   2> 130004 INFO  (coreLoadExecutor-433-thread-1-processing-n:127.0.0.1:56119__io%2Ftv) [n:127.0

[...truncated too long message...]

nit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4896403 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[AAFB6F0BC146A2FD]-worker) [n:127.0.0.1:47214__dnu%2Fah c:addReplicaColl s:shard2 r:core_node1 x:addReplicaColl_shard2_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 09, 2015 11:58:46 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=sv, timezone=Asia/Dubai
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=3,free=46723448,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [MBeansHandlerTest, HLLSerializationTest, ClusterStateUpdateTest, BitVectorTest, TestFreeTextSuggestions, MinimalSchemaTest, SpellCheckCollatorTest, DistributedTermsComponentTest, TestMissingGroups, TestAuthenticationFramework, NotRequiredUniqueKeyTest, AnalyticsQueryTest, CollectionsAPIDistributedZkTest, TestOverriddenPrefixQueryForCustomFieldType, TestRuleBasedAuthorizationPlugin, TestStressVersions, LoggingHandlerTest, TestFieldTypeResource, TermVectorComponentTest, TestJsonRequest, MergeStrategyTest, BasicFunctionalityTest, CSVRequestHandlerTest, DistributedExpandComponentTest, TestSolrQueryParserResource, ZkCLITest, TestBlendedInfixSuggestions, TestObjectReleaseTracker, SuggestComponentTest, TestCloudPivotFacet, ShardRoutingTest, TestReloadDeadlock, CachingDirectoryFactoryTest, FastVectorHighlighterTest, DistributedFacetPivotLongTailTest, ChaosMonkeySafeLeaderTest, DocumentBuilderTest, SimplePostToolTest, HdfsRecoverLeaseTest, ShardRoutingCustomTest, AsyncCallRequestStatusResponseTest, ChaosMonkeyNothingIsSafeTest, TestQueryTypes, TestStressUserVersions, TriLevelCompositeIdRoutingTest, TestDynamicLoading, CollectionsAPIAsyncDistributedZkTest, TestLeaderElectionZkExpiry, AddSchemaFieldsUpdateProcessorFactoryTest, SpellPossibilityIteratorTest, TestUtils, TestLFUCache, DOMUtilTest, TermsComponentTest, SolrCmdDistributorTest, TestShortCircuitedRequests, BJQParserTest, CoreAdminRequestStatusTest, DocExpirationUpdateProcessorFactoryTest, ZkSolrClientTest, ConvertedLegacyTest, TestConfigSets, TestJettySolrRunner, SoftAutoCommitTest, TestDFRSimilarityFactory, TestUpdate, TestQuerySenderNoQuery, MultiTermTest, TestManagedSchema, ShardSplitTest, TestQuerySenderListener, TestSchemaManager, SliceStateTest, HLLUtilTest, TestRTGBase, FacetPivotSmallTest, UniqFieldsUpdateProcessorFactoryTest, TestCustomDocTransformer, DistanceFunctionTest, PreAnalyzedUpdateProcessorTest, DeleteLastCustomShardedReplicaTest, TestClusterStateMutator, HdfsLockFactoryTest, SpatialFilterTest, TestWordDelimiterFilterFactory, TestBM25SimilarityFactory, DistributedFacetPivotSmallTest, TestFileDictionaryLookup, TestCodecSupport, IndexBasedSpellCheckerTest, TestRandomFaceting, TestZkChroot, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestHashPartitioner, DistributedSpellCheckComponentTest, ZkControllerTest, TestRealTimeGet, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, StatsComponentTest, TestLazyCores, TestBadConfig, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CoreAdminHandlerTest, TestStressLucene, TestCSVLoader, SchemaVersionSpecificBehaviorTest, QueryEqualityTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, DebugComponentTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, RequestHandlersTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, TestCollationField, JSONWriterTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, SearchHandlerTest, ResponseLogComponentTest, SolrIndexConfigTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, NumericFieldsTest, TestConfig, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestCharFilters, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestJmxMonitoredMap, ResourceLoaderTest, TestFastOutputStream, URLClassifyProcessorTest, TestFastLRUCache, DateMathParserTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, TestLRUCache, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, CursorPagingTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, AsyncMigrateRouteKeyTest, CdcrRequestHandlerTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, ConcurrentDeleteAndCreateCollectionTest, DeleteInactiveReplicaTest, DeleteShardTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, LeaderInitiatedRecoveryOnCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, RemoteQueryErrorTest, ReplicationFactorTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCollectionAPI, TestConfigSetsAPI, TestConfigSetsAPIExclusivity, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestMiniSolrCloudClusterBase, TestRandomRequestDistribution, TestReplicaProperties, VMParamsZkACLAndCredentialsProvidersTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [544/544] on J1 in 1421.84s, 1 test, 1 error <<< FAILURES!

[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 544 suites, 2142 tests, 2 errors, 1 failure, 29 ignored (17 assumptions)

Total time: 191 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 789 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/789/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:55860/qm_qk/q: Could not load collection from ZK:halfcollectionblocker

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55860/qm_qk/q: Could not load collection from ZK:halfcollectionblocker
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:419)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=3438, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3438, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:53350/p/jb: Could not find collection : awholynewstresscollection_collection4_0
	at __randomizedtesting.SeedInfo.seed([642EB9E4113325B5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10194 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/init-core-data-001
   [junit4]   2> 198267 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 198268 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /p/jb
   [junit4]   2> 199027 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 199719 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 199905 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 199915 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 199997 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 200052 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_50474_hdfs____.8e9i9s/webapp
   [junit4]   2> 200264 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 201232 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50474
   [junit4]   2> 202534 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 202541 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 202557 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_59159_datanode____.tzcnjc/webapp
   [junit4]   2> 202666 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 203176 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:59159
   [junit4]   2> 203419 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 203421 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 203442 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_57051_datanode____shh3l/webapp
   [junit4]   2> 203580 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 204200 INFO  (IPC Server handler 2 on 33296) [    ] BlockStateChange BLOCK* processReport: from storage DS-ca9fb14e-6eea-4d13-8a71-bc177dfe6168 node DatanodeRegistration(127.0.0.1, datanodeUuid=6808aacc-b3bd-4637-9774-914677faaf11, infoPort=59159, ipcPort=47368, storageInfo=lv=-56;cid=testClusterID;nsid=1055292187;c=0), blocks: 0, hasStaleStorages: true, processing time: 3 msecs
   [junit4]   2> 204202 INFO  (IPC Server handler 2 on 33296) [    ] BlockStateChange BLOCK* processReport: from storage DS-ef70f2be-9c23-418d-af2d-f5c911e96654 node DatanodeRegistration(127.0.0.1, datanodeUuid=6808aacc-b3bd-4637-9774-914677faaf11, infoPort=59159, ipcPort=47368, storageInfo=lv=-56;cid=testClusterID;nsid=1055292187;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 204359 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57051
   [junit4]   2> 204565 INFO  (IPC Server handler 2 on 33296) [    ] BlockStateChange BLOCK* processReport: from storage DS-c4f09b4f-b5a5-43f3-89b2-b0e3c148bf6e node DatanodeRegistration(127.0.0.1, datanodeUuid=f9afbb73-69ee-4fe9-b908-25ca5da0f0a6, infoPort=57051, ipcPort=59037, storageInfo=lv=-56;cid=testClusterID;nsid=1055292187;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 204566 INFO  (IPC Server handler 2 on 33296) [    ] BlockStateChange BLOCK* processReport: from storage DS-6c4feef8-80ab-4188-b3b0-37637de6ef49 node DatanodeRegistration(127.0.0.1, datanodeUuid=f9afbb73-69ee-4fe9-b908-25ca5da0f0a6, infoPort=57051, ipcPort=59037, storageInfo=lv=-56;cid=testClusterID;nsid=1055292187;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 205250 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 205251 INFO  (Thread-634) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 205251 INFO  (Thread-634) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 205351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ZkTestServer start zk server on port:56550
   [junit4]   2> 205351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 205352 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 205357 INFO  (zkCallback-175-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@542d75fa name:ZooKeeperConnection Watcher:127.0.0.1:56550 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 205357 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 205358 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 205358 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 205366 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 205370 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 205374 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53a4fe05 name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 205374 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 205374 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 205374 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 205377 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 205378 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 205379 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 205381 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 205381 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 205383 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 205384 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 205385 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 205386 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 205387 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 205388 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 205389 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 205389 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 205391 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 205391 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 205392 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 205393 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 205394 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 205394 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 205396 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 205396 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 205399 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 205399 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 205401 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 205401 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 205410 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 205414 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 205427 INFO  (zkCallback-177-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ed24cc4 name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 205427 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 205427 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 205739 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores/collection1
   [junit4]   2> 205757 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 205759 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@37aa1953{/p/jb,null,AVAILABLE}
   [junit4]   2> 205840 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4070ccca{SSL-http/1.1}{127.0.0.1:53350}
   [junit4]   2> 205840 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.Server Started @209379ms
   [junit4]   2> 205841 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:33296/hdfs__localhost_33296__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001_tempDir-002_control_data, hostContext=/p/jb, hostPort=53350, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores}
   [junit4]   2> 205841 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 205841 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/'
   [junit4]   2> 205858 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 205858 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 205861 INFO  (zkCallback-178-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69d4e6e9 name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 205861 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 205861 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 205863 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 205863 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/solr.xml
   [junit4]   2> 205871 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores
   [junit4]   2> 205871 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoreContainer New CoreContainer 465967252
   [junit4]   2> 205871 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/]
   [junit4]   2> 205871 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/lib
   [junit4]   2> 205871 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/lib).
   [junit4]   2> 205880 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 205889 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 205891 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 205891 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 205891 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56550/solr
   [junit4]   2> 205891 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 205891 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 205892 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 205897 INFO  (zkCallback-180-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@61ea7773 name:ZooKeeperConnection Watcher:127.0.0.1:56550 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 205897 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 205898 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 205902 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 205912 INFO  (zkCallback-181-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1fa7c921 name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 205912 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 205914 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 205918 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 205921 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 205923 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 205924 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 205926 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 205928 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 205929 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 205930 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 205931 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53350_p%2Fjb
   [junit4]   2> 205931 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53350_p%2Fjb
   [junit4]   2> 205933 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 205934 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 205935 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 205935 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000
   [junit4]   2> 205936 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53350_p%2Fjb
   [junit4]   2> 205936 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 205937 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer Overseer (id=94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) starting
   [junit4]   2> 205939 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 205943 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 205944 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 205945 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 205950 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 205951 INFO  (OverseerCollectionConfigSetProcessor-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 205990 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 205990 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 205991 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores
   [junit4]   2> 205992 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 205992 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores/collection1/
   [junit4]   2> 205993 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 205996 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 205996 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 205996 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 205996 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 205998 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53350/p/jb",
   [junit4]   2>   "node_name":"127.0.0.1:53350_p%2Fjb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 205998 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 206000 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53350/p/jb",
   [junit4]   2>   "node_name":"127.0.0.1:53350_p%2Fjb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 206000 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 206000 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 206002 INFO  (zkCallback-181-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 206006 INFO  (zkCallback-181-thread-2-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 207000 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 207000 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 207001 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 207001 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 207002 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 207002 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores/collection1/'
   [junit4]   2> 207018 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 207024 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 207028 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 207042 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 207044 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 207058 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 207187 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 207196 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 207197 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 207208 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 207211 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 207220 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 207221 WARN  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 207221 WARN  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 207221 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 207222 WARN  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 207222 WARN  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 207223 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 207223 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 207223 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 207237 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:33296/solr_hdfs_home
   [junit4]   2> 207237 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 207238 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 207238 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc94f15
   [junit4]   2> 207238 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 207344 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
   [junit4]   2> 207344 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 207350 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 207387 WARN  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:33296/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 207387 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 207443 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
   [junit4]   2> 207443 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 207449 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@fd77165
   [junit4]   2> 207858 INFO  (IPC Server handler 3 on 33296) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60749 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-ca9fb14e-6eea-4d13-8a71-bc177dfe6168:NORMAL:127.0.0.1:42822|RBW], ReplicaUnderConstruction[[DISK]DS-c4f09b4f-b5a5-43f3-89b2-b0e3c148bf6e:NORMAL:127.0.0.1:60749|RBW]]} size 71
   [junit4]   2> 207860 INFO  (IPC Server handler 2 on 33296) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42822 is added to blk_1073741825_1001 size 71
   [junit4]   2> 208294 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b6078446 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a5d2867; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 208294 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 208309 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 208311 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 208311 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 208311 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 208312 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 208312 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 208312 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 208312 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 208312 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 208320 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 208322 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 208323 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 208324 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 208328 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:33296/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 208341 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 208341 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 208379 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 208380 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 208420 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 208424 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 208436 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 208610 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b6078446 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a5d2867; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 208610 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 208611 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@c3088d2[collection1] main
   [junit4]   2> 208611 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 208612 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 208612 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 208612 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 208612 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 208613 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 208613 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 208613 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 208613 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 208614 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 208616 INFO  (searcherExecutor-590-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@c3088d2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 208628 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 208628 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 208628 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 208628 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511741177175474176
   [junit4]   2> 208628 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1511741177175474176
   [junit4]   2> 208628 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 208629 INFO  (coreLoadExecutor-589-thread-1-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 208638 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:53350/p/jb collection:control_collection shard:shard1
   [junit4]   2> 208650 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 208655 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94483823352217605-core_node1-n_0000000000
   [junit4]   2> 208655 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 208657 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 208657 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 208657 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 208657 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53350/p/jb/collection1/
   [junit4]   2> 208658 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 208658 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:53350/p/jb/collection1/ has no replicas
   [junit4]   2> 208658 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53350/p/jb/collection1/ shard1
   [junit4]   2> 208658 INFO  (zkCallback-181-thread-2-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 208659 INFO  (zkCallback-181-thread-3-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 208662 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 208663 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 208666 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:53350/p/jb",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 208774 INFO  (zkCallback-181-thread-2-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 208774 INFO  (zkCallback-181-thread-3-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 208817 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:53350/p/jb/collection1/ and leader is https://127.0.0.1:53350/p/jb/collection1/
   [junit4]   2> 208817 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:53350/p/jb
   [junit4]   2> 208817 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 208817 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 208817 INFO  (coreZkRegister-583-thread-1-processing-n:127.0.0.1:53350_p%2Fjb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:53350_p%2Fjb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 208819 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53350/p/jb",
   [junit4]   2>   "node_name":"127.0.0.1:53350_p%2Fjb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 208820 INFO  (OverseerStateUpdate-94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53350/p/jb",
   [junit4]   2>   "node_name":"127.0.0.1:53350_p%2Fjb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 208926 INFO  (zkCallback-181-thread-3-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 208926 INFO  (zkCallback-181-thread-2-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 209011 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 209038 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 209062 INFO  (zkCallback-183-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a0d51ba name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 209062 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 209062 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 209063 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 209065 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 210170 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores/collection1
   [junit4]   2> 210171 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001
   [junit4]   2> 210183 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 210257 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2f8e82a4{/p/jb,null,AVAILABLE}
   [junit4]   2> 210272 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3c55987f{SSL-http/1.1}{127.0.0.1:50695}
   [junit4]   2> 210272 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.e.j.s.Server Started @213811ms
   [junit4]   2> 210272 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:33296/hdfs__localhost_33296__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/p/jb, hostPort=50695, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores}
   [junit4]   2> 210273 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 210273 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/'
   [junit4]   2> 210390 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 210439 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 210454 INFO  (zkCallback-184-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74f52d42 name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 210454 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 210455 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 210462 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 210463 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/solr.xml
   [junit4]   2> 210470 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores
   [junit4]   2> 210471 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoreContainer New CoreContainer 767297369
   [junit4]   2> 210471 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/]
   [junit4]   2> 210471 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/lib
   [junit4]   2> 210471 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/lib).
   [junit4]   2> 210521 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 210553 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 210557 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 210557 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 210557 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56550/solr
   [junit4]   2> 210557 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 210558 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 210567 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 210583 INFO  (zkCallback-186-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@612ef8c4 name:ZooKeeperConnection Watcher:127.0.0.1:56550 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 210587 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 210587 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 210602 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 210630 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:50695_p%2Fjb) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7e3ebb26 name:ZooKeeperConnection Watcher:127.0.0.1:56550/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 210630 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 210637 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 211645 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50695_p%2Fjb
   [junit4]   2> 211645 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50695_p%2Fjb
   [junit4]   2> 211647 INFO  (zkCallback-181-thread-2-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 211647 INFO  (zkCallback-187-thread-1-processing-n:127.0.0.1:50695_p%2Fjb) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 211647 INFO  (zkCallback-181-thread-3-processing-n:127.0.0.1:53350_p%2Fjb) [n:127.0.0.1:53350_p%2Fjb    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 211647 INFO  (zkCallback-183-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 211652 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 211653 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94483823352217609-127.0.0.1:50695_p%2Fjb-n_0000000001
   [junit4]   2> 211653 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94483823352217605-127.0.0.1:53350_p%2Fjb-n_0000000000 to know if I could be the leader
   [junit4]   2> 211696 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 211696 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 211697 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores
   [junit4]   2> 211700 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 211700 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_642EB9E4113325B5-001/shard-1-001/cores/collection1/
   [junit4]   2> 211700 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[642EB9E4113325B5]) [n:127.0.0.1:50695_p%2Fjb    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 211720 INFO  (coreLoadExecutor-600-thread-1-processing-n:127.0.0.1:50695_p%2Fjb) [n:127.0.0.1:50695_p%2Fjb c:collection1   x:collection1] o.a.s.c.ZkController 

[...truncated too long message...]

6984, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:48851/qm_qk/q, http://127.0.0.1:55860/qm_qk/q, http://127.0.0.1:35141/qm_qk/q, http://127.0.0.1:46747/qm_qk/q, http://127.0.0.1:45754/qm_qk/q]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([642EB9E4113325B5]:0)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:48851/qm_qk/q, http://127.0.0.1:55860/qm_qk/q, http://127.0.0.1:35141/qm_qk/q, http://127.0.0.1:46747/qm_qk/q, http://127.0.0.1:45754/qm_qk/q]
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:46747/qm_qk/q
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:572)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	... 5 more
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    > 	at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    > 	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:170)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    > 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:465)
   [junit4]    > 	... 9 more
   [junit4]   2> 1917093 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[642EB9E4113325B5]-worker) [n:127.0.0.1:45754_qm_qk%2Fq c:nodes_used_collection s:shard1 r:core_node4 x:nodes_used_collection_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_642EB9E4113325B5-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l_dv=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=Lucene50(blocksize=128), a_t=Lucene50(blocksize=128), intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_i1=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_i_dv=Lucene50(blocksize=128), text=PostingsFormat(name=Memory doPackFST= false), range_facet_l=Lucene50(blocksize=128), timestamp=Lucene50(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=hi_IN, timezone=Asia/Ujung_Pandang
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=57578256,total=478674944
   [junit4]   2> NOTE: All tests run in this JVM: [ClusterStateUpdateTest, TestBlendedInfixSuggestions, URLClassifyProcessorTest, TestLeaderElectionZkExpiry, TestDistribDocBasedVersion, TestConfigOverlay, TestRemoveLastDynamicCopyField, ShardRoutingCustomTest, PreAnalyzedFieldTest, TestCustomDocTransformer, BJQParserTest, TestStressVersions, TestRTGBase, CSVRequestHandlerTest, DistributedFacetPivotWhiteBoxTest, TestCoreContainer, ChaosMonkeySafeLeaderTest, TestSchemaVersionResource, TestWordDelimiterFilterFactory, DocumentBuilderTest, HighlighterTest, SolrCmdDistributorTest, SolrCloudExampleTest, HdfsChaosMonkeySafeLeaderTest, TestHashPartitioner, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudPivotFacet, DistributedQueueTest, NumericFieldsTest, TestShortCircuitedRequests, TestFiltering, TestFastOutputStream, WordBreakSolrSpellCheckerTest, HLLSerializationTest, TestJsonRequest, TestSchemaManager, TestDistributedGrouping, DistanceUnitsTest, UpdateRequestProcessorFactoryTest, DocExpirationUpdateProcessorFactoryTest, TestMaxScoreQueryParser, HdfsRecoveryZkTest, TestDynamicLoading, TestJsonFacets, DistributedFacetPivotLongTailTest, TestUpdate, TestDownShardTolerantSearch, TestCustomSort, SoftAutoCommitTest, TestSolrQueryParserResource, SliceStateTest, VMParamsZkACLAndCredentialsProvidersTest, SpellCheckCollatorTest, MoreLikeThisHandlerTest, HdfsRecoverLeaseTest, TestFieldCollectionResource, TestSortByMinMaxFunction, CircularListTest, TestCodecSupport, DOMUtilTest, SSLMigrationTest, TestTrie, HdfsNNFailoverTest, AsyncCallRequestStatusResponseTest, TestManagedSchema, SchemaVersionSpecificBehaviorTest, SpatialFilterTest, TestSortingResponseWriter, TestSolrDeletionPolicy2, TestSurroundQueryParser, DirectSolrSpellCheckerTest, MergeStrategyTest, SortByFunctionTest, PreAnalyzedUpdateProcessorTest, TestEmbeddedSolrServerConstructors, FastVectorHighlighterTest, TestCrossCoreJoin, DistributedExpandComponentTest, BitVectorTest, CdcrRequestHandlerTest, TestLMJelinekMercerSimilarityFactory, AddSchemaFieldsUpdateProcessorFactoryTest, RuleEngineTest, AnalyticsQueryTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed [195/544] on J1 in 736.43s, 1 test, 1 error <<< FAILURES!

[...truncated 1135 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 544 suites, 2141 tests, 2 errors, 29 ignored (17 assumptions)

Total time: 187 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 788 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/788/

1 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=38041, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=38041, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:49925/_vi/hf: Could not find collection : awholynewstresscollection_collection5_0
	at __randomizedtesting.SeedInfo.seed([DE08134BD698D156]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 11443 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/init-core-data-001
   [junit4]   2> 4313520 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 4313520 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_vi/hf
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4313619 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4313636 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4313641 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4313655 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_43364_hdfs____.z79z44/webapp
   [junit4]   2> 4313909 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4314707 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43364
   [junit4]   2> 4315121 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4315122 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4315134 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_52202_datanode____.c8j63m/webapp
   [junit4]   2> 4315331 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4315815 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:52202
   [junit4]   2> 4316026 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4316028 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4316049 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41709_datanode____.6if06u/webapp
   [junit4]   2> 4316168 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4316434 INFO  (IPC Server handler 4 on 47898) [    ] BlockStateChange BLOCK* processReport: from storage DS-e2fef903-376f-4977-83bc-3b460a19f524 node DatanodeRegistration(127.0.0.1, datanodeUuid=20dd86b3-df9c-41f0-baa7-9f8d65afd619, infoPort=52202, ipcPort=40266, storageInfo=lv=-56;cid=testClusterID;nsid=569659897;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4316435 INFO  (IPC Server handler 4 on 47898) [    ] BlockStateChange BLOCK* processReport: from storage DS-9ef25a07-0523-41b1-b7b3-04b22a96a54a node DatanodeRegistration(127.0.0.1, datanodeUuid=20dd86b3-df9c-41f0-baa7-9f8d65afd619, infoPort=52202, ipcPort=40266, storageInfo=lv=-56;cid=testClusterID;nsid=569659897;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4316687 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[DE08134BD698D156]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41709
   [junit4]   2> 4317094 INFO  (IPC Server handler 8 on 47898) [    ] BlockStateChange BLOCK* processReport: from storage DS-e478a387-992d-4fc5-a125-624d637d52fa node DatanodeRegistration(127.0.0.1, datanodeUuid=c7530253-8e0f-4b7d-8b5f-9809e59117bd, infoPort=41709, ipcPort=42014, storageInfo=lv=-56;cid=testClusterID;nsid=569659897;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4317096 INFO  (IPC Server handler 8 on 47898) [    ] BlockStateChange BLOCK* processReport: from storage DS-7fa373e8-aca3-4428-96be-af417bf23a28 node DatanodeRegistration(127.0.0.1, datanodeUuid=c7530253-8e0f-4b7d-8b5f-9809e59117bd, infoPort=41709, ipcPort=42014, storageInfo=lv=-56;cid=testClusterID;nsid=569659897;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4317285 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4317290 INFO  (Thread-21517) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4317290 INFO  (Thread-21517) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4317390 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ZkTestServer start zk server on port:51500
   [junit4]   2> 4317390 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4317407 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4317434 INFO  (zkCallback-3685-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@481812c0 name:ZooKeeperConnection Watcher:127.0.0.1:51500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4317435 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4317435 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4317435 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4317438 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4317450 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4317466 INFO  (zkCallback-3686-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2595c9c1 name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4317466 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4317467 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4317467 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 4317469 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 4317470 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 4317471 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 4317472 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 4317472 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4317474 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 4317474 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 4317476 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4317476 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4317477 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 4317478 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4317479 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 4317479 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4317480 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 4317481 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 4317482 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4317482 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4317483 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4317484 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4317485 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4317485 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4317486 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4317486 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4317488 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 4317488 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4317490 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4317514 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4317530 INFO  (zkCallback-3687-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58ff8eec name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4317530 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4317531 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4317532 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4317546 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4317557 INFO  (zkCallback-3688-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1037d2c9 name:ZooKeeperConnection Watcher:127.0.0.1:51500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4317557 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4317558 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4317558 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4317560 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4317578 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4317606 INFO  (zkCallback-3689-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@787f03b8 name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4317606 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4317606 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4317607 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 4317607 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 4317609 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 4317609 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 4317611 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 4317611 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 4317613 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4317613 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4317614 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 4317614 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 4317616 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 4317616 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 4317617 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 4317617 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 4317619 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 4317619 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 4317620 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4317620 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4317622 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 4317622 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 4317623 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 4317624 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 4317625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 4317625 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 4318024 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores/collection1
   [junit4]   2> 4318028 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 4318031 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@280b6d0c{/_vi/hf,null,AVAILABLE}
   [junit4]   2> 4318035 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3286d8ae{SSL-http/1.1}{127.0.0.1:39716}
   [junit4]   2> 4318036 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.Server Started @4322406ms
   [junit4]   2> 4318036 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:47898/hdfs__localhost_47898__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001_tempDir-002_control_data, hostContext=/_vi/hf, hostPort=39716, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores}
   [junit4]   2> 4318036 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 4318036 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/'
   [junit4]   2> 4318052 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4318054 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4318058 INFO  (zkCallback-3690-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63c7ac5a name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4318058 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4318058 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4318060 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 4318060 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/solr.xml
   [junit4]   2> 4318065 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores
   [junit4]   2> 4318065 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoreContainer New CoreContainer 77122461
   [junit4]   2> 4318065 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/]
   [junit4]   2> 4318065 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/lib
   [junit4]   2> 4318066 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/lib).
   [junit4]   2> 4318073 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4318075 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4318077 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4318077 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4318077 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51500/solr
   [junit4]   2> 4318077 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4318077 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4318078 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4318080 INFO  (zkCallback-3692-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c43328f name:ZooKeeperConnection Watcher:127.0.0.1:51500 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4318080 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4318080 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4318083 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4318083 INFO  (zkCallback-3693-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@759fcccf name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4318083 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4318084 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 4318086 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 4318088 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 4318090 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 4318091 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 4318093 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4318094 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4318095 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4318096 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4318097 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39716__vi%2Fhf
   [junit4]   2> 4318098 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39716__vi%2Fhf
   [junit4]   2> 4318099 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 4318100 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 4318101 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4318101 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000
   [junit4]   2> 4318102 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39716__vi%2Fhf
   [junit4]   2> 4318102 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 4318103 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer Overseer (id=94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) starting
   [junit4]   2> 4318104 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 4318109 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4318110 INFO  (OverseerCollectionConfigSetProcessor-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 4318110 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 4318111 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4318123 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4318148 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 4318148 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 4318149 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores
   [junit4]   2> 4318150 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 4318150 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores/collection1/
   [junit4]   2> 4318150 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 4318155 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 4318155 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 4318158 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 4318158 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 4318159 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39716/_vi/hf",
   [junit4]   2>   "node_name":"127.0.0.1:39716__vi%2Fhf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 4318160 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 4318160 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39716/_vi/hf",
   [junit4]   2>   "node_name":"127.0.0.1:39716__vi%2Fhf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4318160 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 4318161 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 4318162 INFO  (zkCallback-3693-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4318170 INFO  (zkCallback-3693-thread-2-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4319160 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4319160 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 4319161 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 4319161 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 4319162 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4319162 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores/collection1/'
   [junit4]   2> 4319186 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 4319190 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4319194 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 4319254 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4319257 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 4319262 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 4319342 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4319359 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 4319360 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4319389 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4319391 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4319393 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4319394 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 4319395 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 4319395 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4319396 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 4319396 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 4319402 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 4319402 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 4319402 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 4319404 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:47898/solr_hdfs_home
   [junit4]   2> 4319404 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4319404 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 4319404 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@262b74fc
   [junit4]   2> 4319405 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4319479 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 4324482 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsDirectory The NameNode is in SafeMode - Solr will wait 5 seconds and try again.
   [junit4]   2> 4329486 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
   [junit4]   2> 4329486 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4329490 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 4329511 WARN  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:47898/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 4329511 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4329541 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
   [junit4]   2> 4329541 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4329545 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=670581922, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 4329637 INFO  (IPC Server handler 7 on 47898) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55747 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9ef25a07-0523-41b1-b7b3-04b22a96a54a:NORMAL:127.0.0.1:51178|RBW], ReplicaUnderConstruction[[DISK]DS-7fa373e8-aca3-4428-96be-af417bf23a28:NORMAL:127.0.0.1:55747|RBW]]} size 0
   [junit4]   2> 4329640 INFO  (IPC Server handler 5 on 47898) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51178 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-7fa373e8-aca3-4428-96be-af417bf23a28:NORMAL:127.0.0.1:55747|RBW], ReplicaUnderConstruction[[DISK]DS-e2fef903-376f-4977-83bc-3b460a19f524:NORMAL:127.0.0.1:51178|FINALIZED]]} size 0
   [junit4]   2> 4329645 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b7b9c568 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c1c1c42; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4329646 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 4329648 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:47898/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 4329650 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4329651 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4329651 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4329651 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4329651 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4329651 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4329652 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4329652 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4329652 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4329654 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4329655 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4329656 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4329657 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4329660 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 4329661 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4329662 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 4329662 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 4329675 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 4329675 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 4329676 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=6.833984375, floorSegmentMB=1.2783203125, forceMergeDeletesPctAllowed=20.49523558952309, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.875724482398419
   [junit4]   2> 4329687 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b7b9c568 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c1c1c42; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4329687 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 4329688 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6fd3fc9d[collection1] main
   [junit4]   2> 4329688 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 4329690 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4329690 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 4329690 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4329691 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 4329691 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4329692 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4329692 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4329692 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 4329692 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4329693 INFO  (searcherExecutor-9027-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6fd3fc9d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4329697 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 4329697 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 4329697 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 4329698 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511653786622361600
   [junit4]   2> 4329698 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1511653786622361600
   [junit4]   2> 4329698 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 4329699 INFO  (coreLoadExecutor-9026-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 4329700 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:39716/_vi/hf collection:control_collection shard:shard1
   [junit4]   2> 4329701 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 4329705 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94478360851120135-core_node1-n_0000000000
   [junit4]   2> 4329705 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 4329707 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 4329707 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 4329707 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39716/_vi/hf/collection1/
   [junit4]   2> 4329707 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 4329707 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 4329708 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:39716/_vi/hf/collection1/ has no replicas
   [junit4]   2> 4329708 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39716/_vi/hf/collection1/ shard1
   [junit4]   2> 4329708 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 4329708 INFO  (zkCallback-3693-thread-3-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4329708 INFO  (zkCallback-3693-thread-2-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4329711 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 4329713 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:39716/_vi/hf",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 4329816 INFO  (zkCallback-3693-thread-3-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4329816 INFO  (zkCallback-3693-thread-2-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4329866 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:39716/_vi/hf/collection1/ and leader is https://127.0.0.1:39716/_vi/hf/collection1/
   [junit4]   2> 4329866 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:39716/_vi/hf
   [junit4]   2> 4329866 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 4329866 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 4329866 INFO  (coreZkRegister-9020-thread-1-processing-n:127.0.0.1:39716__vi%2Fhf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39716__vi%2Fhf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 4329868 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39716/_vi/hf",
   [junit4]   2>   "node_name":"127.0.0.1:39716__vi%2Fhf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 4329869 INFO  (OverseerStateUpdate-94478360851120135-127.0.0.1:39716__vi%2Fhf-n_0000000000) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39716/_vi/hf",
   [junit4]   2>   "node_name":"127.0.0.1:39716__vi%2Fhf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4329971 INFO  (zkCallback-3693-thread-2-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4329971 INFO  (zkCallback-3693-thread-3-processing-n:127.0.0.1:39716__vi%2Fhf) [n:127.0.0.1:39716__vi%2Fhf    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4330165 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4330180 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4330192 INFO  (zkCallback-3695-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@148e6554 name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4330192 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4330192 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4330193 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4330194 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 4330997 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/cores/collection1
   [junit4]   2> 4330998 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001
   [junit4]   2> 4331002 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 4331038 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@75b2e149{/_vi/hf,null,AVAILABLE}
   [junit4]   2> 4331050 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2d0384b9{SSL-http/1.1}{127.0.0.1:58259}
   [junit4]   2> 4331050 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.e.j.s.Server Started @4335420ms
   [junit4]   2> 4331050 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:47898/hdfs__localhost_47898__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/_vi/hf, hostPort=58259, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/cores}
   [junit4]   2> 4331052 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 4331052 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/'
   [junit4]   2> 4331094 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4331106 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4331113 INFO  (zkCallback-3696-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@29b59e86 name:ZooKeeperConnection Watcher:127.0.0.1:51500/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4331113 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4331114 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4331115 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 4331115 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/solr.xml
   [junit4]   2> 4331119 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/cores
   [junit4]   2> 4331120 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoreContainer New CoreContainer 295635512
   [junit4]   2> 4331120 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/]
   [junit4]   2> 4331120 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/lib
   [junit4]   2> 4331120 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_DE08134BD698D156-001/shard-1-001/lib).
   [junit4]   2> 4331127 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4331150 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4331152 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4331153 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4331153 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51500/solr
   [junit4]   2> 4331153 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4331153 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4331174 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[DE08134BD698D156]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4331194 INFO  (zkCallback-3698-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.

[...truncated too long message...]

ceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-collections-3.2.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jcl-over-slf4j-1.7.7.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/presto-parser-0.108.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/icu/lucene-analyzers-icu-6.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.1.13.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20150907_061737_459.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20150907_061737_459.suites
   [junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1504)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:133)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:964)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:961)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4] 	at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 287 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 787 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/787/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=49918, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=49918, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40713/do/v: Could not find collection : awholynewstresscollection_collection2_0
	at __randomizedtesting.SeedInfo.seed([BC57C84A84422A21]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)


REGRESSION:  org.apache.solr.handler.component.TestDistributedStatsComponentCardinality.test

Error Message:
Captured an uncaught exception in thread: Thread[id=39048, name=Thread-29455, state=RUNNABLE, group=TGRP-TestDistributedStatsComponentCardinality]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=39048, name=Thread-29455, state=RUNNABLE, group=TGRP-TestDistributedStatsComponentCardinality]
	at __randomizedtesting.SeedInfo.seed([BC57C84A84422A21:3403F7902ABE47D9]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51970//collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://[ff01::114]:33332, http://127.0.0.1:38606//collection1, http://[ff01::083]:33332, http://[ff01::213]:33332]
	at __randomizedtesting.SeedInfo.seed([BC57C84A84422A21]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:624)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([BC57C84A84422A21:3403F7902ABE47D9]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.junit.Assert.assertNull(Assert.java:562)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoConfigSetExist(CollectionsAPIDistributedZkTest.java:519)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:166)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9693 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/init-core-data-001
   [junit4]   2> 39080 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 39081 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /e_/b
   [junit4]   2> 41117 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 42921 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 43565 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 43591 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 43759 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 43861 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_57999_hdfs____.dvp0kf/webapp
   [junit4]   2> 44275 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 45328 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57999
   [junit4]   2> 47918 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 47936 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 47970 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_34388_datanode____.2w75if/webapp
   [junit4]   2> 48103 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 48517 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34388
   [junit4]   2> 48841 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 48844 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 48902 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_58963_datanode____.ef5rom/webapp
   [junit4]   2> 49205 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 49841 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BC57C84A84422A21]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:58963
   [junit4]   2> 53166 INFO  (IPC Server handler 0 on 35390) [    ] BlockStateChange BLOCK* processReport: from storage DS-3e003bed-79c0-4cb2-946b-8c820412a82f node DatanodeRegistration(127.0.0.1, datanodeUuid=eab61fbe-7de5-4841-87ae-8d33a0164a4d, infoPort=34388, ipcPort=40618, storageInfo=lv=-56;cid=testClusterID;nsid=577351837;c=0), blocks: 0, hasStaleStorages: true, processing time: 13 msecs
   [junit4]   2> 53174 INFO  (IPC Server handler 0 on 35390) [    ] BlockStateChange BLOCK* processReport: from storage DS-f0d2389b-6010-4096-870d-88cf388c101d node DatanodeRegistration(127.0.0.1, datanodeUuid=eab61fbe-7de5-4841-87ae-8d33a0164a4d, infoPort=34388, ipcPort=40618, storageInfo=lv=-56;cid=testClusterID;nsid=577351837;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 53189 INFO  (IPC Server handler 3 on 35390) [    ] BlockStateChange BLOCK* processReport: from storage DS-8f10944a-482f-4cec-8743-d4c214721bf1 node DatanodeRegistration(127.0.0.1, datanodeUuid=f7938484-b061-4915-8f05-2da051b57bd8, infoPort=58963, ipcPort=55617, storageInfo=lv=-56;cid=testClusterID;nsid=577351837;c=0), blocks: 0, hasStaleStorages: true, processing time: 8 msecs
   [junit4]   2> 53191 INFO  (IPC Server handler 3 on 35390) [    ] BlockStateChange BLOCK* processReport: from storage DS-8ee38728-ca06-4e07-944a-dd30d53f753d node DatanodeRegistration(127.0.0.1, datanodeUuid=f7938484-b061-4915-8f05-2da051b57bd8, infoPort=58963, ipcPort=55617, storageInfo=lv=-56;cid=testClusterID;nsid=577351837;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 54387 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 54470 INFO  (Thread-213) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 54470 INFO  (Thread-213) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 54569 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.ZkTestServer start zk server on port:48961
   [junit4]   2> 54591 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 54749 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 54829 INFO  (zkCallback-16-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@697bbb2e name:ZooKeeperConnection Watcher:127.0.0.1:48961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 54835 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 54836 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 54838 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 54896 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 54919 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 54949 INFO  (zkCallback-17-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3409b548 name:ZooKeeperConnection Watcher:127.0.0.1:48961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 54950 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 54950 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 54951 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 54967 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 54971 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 54973 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 54978 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 54979 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 54984 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 54985 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 55004 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 55004 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 55008 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 55009 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 55012 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 55012 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 55015 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 55015 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 55020 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 55020 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 55024 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 55024 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 55040 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 55041 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 55051 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 55052 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 55061 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 55061 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 55086 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 55108 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 55137 INFO  (zkCallback-18-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c0ebbab name:ZooKeeperConnection Watcher:127.0.0.1:48961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 55137 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 55138 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 55138 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 55154 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 55181 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 55202 INFO  (zkCallback-19-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ea561 name:ZooKeeperConnection Watcher:127.0.0.1:48961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 55202 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 55203 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 55203 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 55204 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 55212 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 55212 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 55218 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 55219 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 55223 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 55224 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 55231 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 55232 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 55234 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 55235 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 55238 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 55238 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 55254 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 55254 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 55257 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 55257 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 55262 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 55263 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 55265 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 55266 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 55278 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 55279 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 56186 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores/collection1
   [junit4]   2> 56189 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 56192 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47369c64{/e_/b,null,AVAILABLE}
   [junit4]   2> 56192 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.ServerConnector Started ServerConnector@5204ff2e{HTTP/1.1}{127.0.0.1:49420}
   [junit4]   2> 56193 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.Server Started @61239ms
   [junit4]   2> 56194 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:35390/hdfs__localhost_35390__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001_tempDir-002_control_data, hostContext=/e_/b, hostPort=49420, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores}
   [junit4]   2> 56195 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 56195 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/'
   [junit4]   2> 56211 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 56212 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 56225 INFO  (zkCallback-20-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@73304c25 name:ZooKeeperConnection Watcher:127.0.0.1:48961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 56225 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 56226 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 56229 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 56229 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/solr.xml
   [junit4]   2> 56253 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores
   [junit4]   2> 56254 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoreContainer New CoreContainer 79766839
   [junit4]   2> 56254 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/]
   [junit4]   2> 56254 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/lib
   [junit4]   2> 56254 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/lib).
   [junit4]   2> 56263 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 56276 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 56276 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 56277 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 56277 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48961/solr
   [junit4]   2> 56302 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 56302 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 56317 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 56341 INFO  (zkCallback-22-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3061776c name:ZooKeeperConnection Watcher:127.0.0.1:48961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 56342 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 56342 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 56367 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 56370 INFO  (zkCallback-23-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@64578216 name:ZooKeeperConnection Watcher:127.0.0.1:48961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 56370 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 56380 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 56389 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 56395 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 56400 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 56403 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 56417 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 56420 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 56422 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 56425 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 56426 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49420_e_%2Fb
   [junit4]   2> 56429 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49420_e_%2Fb
   [junit4]   2> 56436 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 56438 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 56447 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 56448 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000
   [junit4]   2> 56454 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49420_e_%2Fb
   [junit4]   2> 56454 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 56457 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer Overseer (id=94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) starting
   [junit4]   2> 56465 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 56506 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 56510 INFO  (OverseerCollectionConfigSetProcessor-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 56512 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 56513 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 56540 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 56596 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 56597 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 56598 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores
   [junit4]   2> 56602 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 56602 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores/collection1/
   [junit4]   2> 56602 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 56605 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 56605 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 56628 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 56628 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 56630 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49420/e_/b",
   [junit4]   2>   "node_name":"127.0.0.1:49420_e_%2Fb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 56637 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 56643 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49420/e_/b",
   [junit4]   2>   "node_name":"127.0.0.1:49420_e_%2Fb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 56649 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 56686 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 56693 INFO  (zkCallback-23-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 56715 INFO  (zkCallback-23-thread-2-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 57638 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 57638 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 57641 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 57642 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 57643 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 57643 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores/collection1/'
   [junit4]   2> 57672 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 57707 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 57712 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 57755 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 57764 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 57791 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 58048 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 58060 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 58061 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 58105 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 58111 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 58131 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 58134 WARN  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 58134 WARN  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 58134 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 58138 WARN  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 58138 WARN  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 58139 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 58140 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 58140 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 58186 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:35390/solr_hdfs_home
   [junit4]   2> 58186 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 58186 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 58187 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3646a07c
   [junit4]   2> 58209 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 58362 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
   [junit4]   2> 58362 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 58379 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 58421 WARN  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:35390/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 58421 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 58453 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
   [junit4]   2> 58454 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 58454 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=5, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8697642508094462]
   [junit4]   2> 58904 INFO  (IPC Server handler 5 on 35390) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:58252 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f0d2389b-6010-4096-870d-88cf388c101d:NORMAL:127.0.0.1:36333|RBW], ReplicaUnderConstruction[[DISK]DS-8f10944a-482f-4cec-8743-d4c214721bf1:NORMAL:127.0.0.1:58252|RBW]]} size 71
   [junit4]   2> 59113 INFO  (IPC Server handler 2 on 35390) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:36333 is added to blk_1073741825_1001 size 71
   [junit4]   2> 59520 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b645ca7c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c84fc0d; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 59520 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 59532 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 59533 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:35390/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 59543 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 59544 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 59544 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 59544 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 59544 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 59544 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 59545 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 59545 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 59547 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 59559 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 59562 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 59567 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 59596 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 59597 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 59603 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 59603 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 59642 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 59642 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 59645 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@74ce37b1
   [junit4]   2> 59749 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b645ca7c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c84fc0d; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 59750 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 59750 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@271e9936[collection1] main
   [junit4]   2> 59750 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 59751 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 59752 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 59754 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 59754 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 59755 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 59757 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 59757 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 59757 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 59757 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 59762 INFO  (searcherExecutor-142-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@271e9936[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 59773 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 59773 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 59773 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 59773 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511558413761380352
   [junit4]   2> 59774 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1511558413761380352
   [junit4]   2> 59775 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 59777 INFO  (coreLoadExecutor-141-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 59788 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:49420/e_/b collection:control_collection shard:shard1
   [junit4]   2> 59800 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 59816 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94472400519757830-core_node1-n_0000000000
   [junit4]   2> 59817 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 59824 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 59825 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 59825 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 59827 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49420/e_/b/collection1/
   [junit4]   2> 59828 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 59828 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:49420/e_/b/collection1/ has no replicas
   [junit4]   2> 59828 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49420/e_/b/collection1/ shard1
   [junit4]   2> 59829 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 59829 INFO  (zkCallback-23-thread-2-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 59829 INFO  (zkCallback-23-thread-1-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 59862 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 59882 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:49420/e_/b",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 59987 INFO  (zkCallback-23-thread-3-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 59987 INFO  (zkCallback-23-thread-2-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 60033 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:49420/e_/b/collection1/ and leader is http://127.0.0.1:49420/e_/b/collection1/
   [junit4]   2> 60034 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49420/e_/b
   [junit4]   2> 60034 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 60034 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 60034 INFO  (coreZkRegister-135-thread-1-processing-n:127.0.0.1:49420_e_%2Fb x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49420_e_%2Fb c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 60039 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49420/e_/b",
   [junit4]   2>   "node_name":"127.0.0.1:49420_e_%2Fb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 60042 INFO  (OverseerStateUpdate-94472400519757830-127.0.0.1:49420_e_%2Fb-n_0000000000) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49420/e_/b",
   [junit4]   2>   "node_name":"127.0.0.1:49420_e_%2Fb",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 60149 INFO  (zkCallback-23-thread-3-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 60149 INFO  (zkCallback-23-thread-2-processing-n:127.0.0.1:49420_e_%2Fb) [n:127.0.0.1:49420_e_%2Fb    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 60150 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 60151 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 60160 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4399d890 name:ZooKeeperConnection Watcher:127.0.0.1:48961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 60160 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 60160 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 60161 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 60171 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 60566 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/cores/collection1
   [junit4]   2> 60567 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001
   [junit4]   2> 60573 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 60579 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1394de9a{/e_/b,null,AVAILABLE}
   [junit4]   2> 60580 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.ServerConnector Started ServerConnector@32558cbc{HTTP/1.1}{127.0.0.1:36013}
   [junit4]   2> 60580 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.e.j.s.Server Started @65627ms
   [junit4]   2> 60580 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:35390/hdfs__localhost_35390__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/e_/b, hostPort=36013, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/cores}
   [junit4]   2> 60580 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 60581 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/'
   [junit4]   2> 60595 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 60596 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 60600 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@553764a4 name:ZooKeeperConnection Watcher:127.0.0.1:48961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 60601 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 60601 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 60603 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x14fa225d20f0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 60605 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 60606 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/solr.xml
   [junit4]   2> 60622 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/cores
   [junit4]   2> 60622 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoreContainer New CoreContainer 1229695005
   [junit4]   2> 60623 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/]
   [junit4]   2> 60623 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BC57C84A84422A21]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BC57C84A84422A21-001/shard-1-001/lib
   [junit4]   2> 60623 WARN  

[...truncated too long message...]

2A21-001/tempDir-001/shard6/cores/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.component.TestDistributedStatsComponentCardinality_BC57C84A84422A21-001/tempDir-001/shard6/cores/collection1/data;done=false>>]
   [junit4]   2> 3670317 INFO  (TEST-TestDistributedStatsComponentCardinality.test-seed#[BC57C84A84422A21]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.component.TestDistributedStatsComponentCardinality_BC57C84A84422A21-001/tempDir-001/shard6/cores/collection1/data
   [junit4]   2> 3670317 INFO  (TEST-TestDistributedStatsComponentCardinality.test-seed#[BC57C84A84422A21]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.component.TestDistributedStatsComponentCardinality_BC57C84A84422A21-001/tempDir-001/shard6/cores/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.component.TestDistributedStatsComponentCardinality_BC57C84A84422A21-001/tempDir-001/shard6/cores/collection1/data/index;done=false>>]
   [junit4]   2> 3670317 INFO  (TEST-TestDistributedStatsComponentCardinality.test-seed#[BC57C84A84422A21]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.handler.component.TestDistributedStatsComponentCardinality_BC57C84A84422A21-001/tempDir-001/shard6/cores/collection1/data/index
   [junit4]   2> 3670322 INFO  (TEST-TestDistributedStatsComponentCardinality.test-seed#[BC57C84A84422A21]) [    x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6a67b05b{/,null,UNAVAILABLE}
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedStatsComponentCardinality -Dtests.method=test -Dtests.seed=BC57C84A84422A21 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=cs_CZ -Dtests.timezone=America/Yellowknife -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR    253s J1 | TestDistributedStatsComponentCardinality.test <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=39048, name=Thread-29455, state=RUNNABLE, group=TGRP-TestDistributedStatsComponentCardinality]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([BC57C84A84422A21:3403F7902ABE47D9]:0)
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51970//collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://[ff01::114]:33332, http://127.0.0.1:38606//collection1, http://[ff01::083]:33332, http://[ff01::213]:33332]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([BC57C84A84422A21]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:624)
   [junit4]   2> 3670371 INFO  (SUITE-TestDistributedStatsComponentCardinality-seed#[BC57C84A84422A21]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {int_i=PostingsFormat(name=LuceneVarGapFixedInterval), range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=FST50, intDefault=PostingsFormat(name=MockRandom), int_i_prehashed_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), long_l_prehashed_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l=FST50, long_l=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=PostingsFormat(name=MockRandom), string_s_prehashed_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), string_s=PostingsFormat(name=LuceneVarGapFixedInterval), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_i_dv=FST50, timestamp=FST50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=cs_CZ, timezone=America/Yellowknife
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=356879184,total=512753664
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedTermsComponentTest, TestSortingResponseWriter, SpellCheckComponentTest, BasicFunctionalityTest, TestCodecSupport, TestDistributedGrouping, ZkStateReaderTest, TermsComponentTest, DistanceFunctionTest, TestRemoveLastDynamicCopyField, SSLMigrationTest, HdfsNNFailoverTest, AsyncCallRequestStatusResponseTest, TestSolrQueryParserResource, PreAnalyzedUpdateProcessorTest, SoftAutoCommitTest, TestJsonFacets, RulesTest, TestLeaderElectionZkExpiry, TestCopyFieldCollectionResource, VMParamsZkACLAndCredentialsProvidersTest, TestSolrCoreProperties, TestQueryTypes, FastVectorHighlighterTest, HighlighterTest, WordBreakSolrSpellCheckerTest, SolrCmdDistributorTest, DocValuesMissingTest, TestAuthenticationFramework, TestFieldCollectionResource, ShardRoutingTest, TestDownShardTolerantSearch, TestDistribDocBasedVersion, SortByFunctionTest, SchemaVersionSpecificBehaviorTest, TestLMJelinekMercerSimilarityFactory, TestShortCircuitedRequests, MoreLikeThisHandlerTest, BufferStoreTest, TestJettySolrRunner, StressHdfsTest, HdfsLockFactoryTest, UniqFieldsUpdateProcessorFactoryTest, RuleEngineTest, TestSQLHandler, ConvertedLegacyTest, AtomicUpdatesTest, TestUtils, MultiTermTest, TestSolrDeletionPolicy2, TestNRTOpen, TestLFUCache, TestFieldTypeResource, ConcurrentDeleteAndCreateCollectionTest, DistributedFacetPivotSmallTest, CoreAdminRequestStatusTest, TestHashPartitioner, SimplePostToolTest, DistribCursorPagingTest, FacetPivotSmallTest, TestCustomDocTransformer, TestTrie, HdfsRecoverLeaseTest, TestFreeTextSuggestions, TestScoreJoinQPScore, TestQueryUtils, ClusterStateUpdateTest, CustomCollectionTest, TestOverriddenPrefixQueryForCustomFieldType, TestReloadDeadlock, TestReqParamsAPI, CachingDirectoryFactoryTest, SpellCheckCollatorTest, TestQuerySenderNoQuery, TestQuerySenderListener, TestStressVersions, TestSchemaManager, TriLevelCompositeIdRoutingTest, TestRuleBasedAuthorizationPlugin, DistributedFacetPivotLongTailTest, DistributedQueueTest, MergeStrategyTest, DistribDocExpirationUpdateProcessorTest, SolrPluginUtilsTest, TestUpdate, TestRTGBase, TestSurroundQueryParser, CollectionsAPIAsyncDistributedZkTest, BasicDistributedZkTest, OpenCloseCoreStressTest, TestReplicationHandler, CloudExitableDirectoryReaderTest, ConnectionManagerTest, DeleteInactiveReplicaTest, DistribJoinFromCollectionTest, LeaderInitiatedRecoveryOnCommitTest, MigrateRouteKeyTest, SolrCloudExampleTest, TestConfigSetsAPI, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestSolrCloudWithKerberosAlt, HdfsChaosMonkeySafeLeaderTest, HdfsThreadLeakTest, TestClusterStateMutator, ZkStateWriterTest, TestConfigOverlay, TestConfigSets, TestDynamicLoading, TestSolrConfigHandler, RequestLoggingTest, TestReplicationHandlerBackup, TestRestoreCore, TestSolrConfigHandlerConcurrent, DistributedFacetPivotSmallAdvancedTest, DistributedQueryComponentOptimizationTest, SuggestComponentTest, TestDistributedStatsComponentCardinality]
   [junit4] Completed [499/544] on J1 in 254.07s, 1 test, 1 error <<< FAILURES!

[...truncated 159 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 544 suites, 2141 tests, 2 errors, 1 failure, 29 ignored (17 assumptions)

Total time: 191 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 786 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/786/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([81827A3A6340E019:89E20F166C4EC812]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestTargetCollectionNotAvailable(CdcrReplicationDistributedZkTest.java:140)
	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:48)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


REGRESSION:  org.apache.solr.cloud.RollingRestartTest.test

Error Message:
Unable to restart (#4): CloudJettyRunner [url=http://127.0.0.1:34491/vxy/collection1]

Stack Trace:
java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=http://127.0.0.1:34491/vxy/collection1]
	at __randomizedtesting.SeedInfo.seed([81827A3A6340E019:9D645E0CDBC8DE1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
	at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=105111, name=collection2, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=105111, name=collection2, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:47534/vc_tb/o: Could not find collection : awholynewstresscollection_collection2_1
	at __randomizedtesting.SeedInfo.seed([81827A3A6340E019]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 9978 lines...]
   [junit4] Suite: org.apache.solr.cloud.CdcrReplicationDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/init-core-data-001
   [junit4]   2> 688321 INFO  (SUITE-CdcrReplicationDistributedZkTest-seed#[81827A3A6340E019]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 688321 INFO  (SUITE-CdcrReplicationDistributedZkTest-seed#[81827A3A6340E019]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 688324 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 688324 INFO  (Thread-3442) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 688324 INFO  (Thread-3442) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 688424 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.ZkTestServer start zk server on port:50926
   [junit4]   2> 688424 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 688425 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 688431 INFO  (zkCallback-546-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@68f5b5cf name:ZooKeeperConnection Watcher:127.0.0.1:50926 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688431 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 688431 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 688431 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 688436 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 688436 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 688444 INFO  (zkCallback-547-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a3d3041 name:ZooKeeperConnection Watcher:127.0.0.1:50926/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688444 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 688444 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 688445 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 688447 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 688449 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 688450 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 688451 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 688452 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 688454 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 688454 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 688460 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 688460 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 688462 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 688462 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 688463 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 688463 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 688465 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 688465 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 688467 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 688467 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 688469 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 688469 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 688470 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 688471 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 688472 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 688472 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 688474 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 688474 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 688476 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTests
   [junit4]   2> 688800 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1
   [junit4]   2> 688801 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 688803 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f57fd88{/,null,AVAILABLE}
   [junit4]   2> 688808 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.ServerConnector Started ServerConnector@13f8e796{HTTP/1.1}{127.0.0.1:57230}
   [junit4]   2> 688808 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.Server Started @692073ms
   [junit4]   2> 688808 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/, hostPort=57230, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores}
   [junit4]   2> 688809 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 688809 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/'
   [junit4]   2> 688823 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 688824 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 688826 INFO  (zkCallback-548-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7156122d name:ZooKeeperConnection Watcher:127.0.0.1:50926/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688827 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 688827 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 688829 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 688829 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/solr.xml
   [junit4]   2> 688834 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores
   [junit4]   2> 688834 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoreContainer New CoreContainer 1056957406
   [junit4]   2> 688835 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/]
   [junit4]   2> 688835 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/lib
   [junit4]   2> 688835 WARN  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/lib).
   [junit4]   2> 688843 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 688844 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 688845 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 688845 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 688845 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50926/solr
   [junit4]   2> 688845 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 688846 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 688848 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 688850 INFO  (zkCallback-550-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@158ea6e0 name:ZooKeeperConnection Watcher:127.0.0.1:50926 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688850 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 688851 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 688860 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 688862 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ed01e91 name:ZooKeeperConnection Watcher:127.0.0.1:50926/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 688863 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 688864 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 688868 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 688871 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 688874 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 688875 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 688877 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 688879 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 688880 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 688882 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 688883 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57230_
   [junit4]   2> 688884 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:57230_
   [junit4]   2> 688885 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 688887 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 688888 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 688889 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94467095224778756-127.0.0.1:57230_-n_0000000000
   [junit4]   2> 688889 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57230_
   [junit4]   2> 688889 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 688891 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer Overseer (id=94467095224778756-127.0.0.1:57230_-n_0000000000) starting
   [junit4]   2> 688892 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 688898 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 688898 INFO  (OverseerCollectionConfigSetProcessor-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 688898 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 688898 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 688910 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 688910 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 688911 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores
   [junit4]   2> 688912 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1, collection=tmp_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 688912 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/
   [junit4]   2> 688912 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 688913 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 688913 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 688914 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 688914 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57230_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 688915 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 688915 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57230",
   [junit4]   2>   "node_name":"127.0.0.1:57230_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 688915 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57230",
   [junit4]   2>   "node_name":"127.0.0.1:57230_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 688916 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ClusterStateMutator building a new cName: tmp_collection
   [junit4]   2> 688916 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 688917 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 689915 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 689915 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
   [junit4]   2> 689916 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Creating collection in ZooKeeper:tmp_collection
   [junit4]   2> 689916 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Looking for collection configName
   [junit4]   2> 689917 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Only one config set found in zk - using it:conf1
   [junit4]   2> 689917 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection
   [junit4]   2> 689918 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader A collections change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections, has occurred - updating...
   [junit4]   2> 689919 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 689919 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 689919 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/'
   [junit4]   2> 689932 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 689937 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 689940 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 689946 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 689947 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 689951 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 690028 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 690029 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 690029 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 690032 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 690053 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 690053 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
   [junit4]   2> 690053 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 690053 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 690053 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@773f3290
   [junit4]   2> 690054 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/data
   [junit4]   2> 690054 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/data/index/
   [junit4]   2> 690054 WARN  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 690055 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/data/index
   [junit4]   2> 690055 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@7ddc9808
   [junit4]   2> 690056 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@4840197b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57169766; maxCacheMB=0.7099609375 maxMergeSizeMB=0.68359375)),segFN=segments_1,generation=1}
   [junit4]   2> 690056 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 690056 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/data/
   [junit4]   2> 690056 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 690060 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
   [junit4]   2> 690076 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 690082 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 690083 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 690084 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 690085 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 690096 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/cdcr,/update,/admin/file
   [junit4]   2> 690097 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 690107 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 690108 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 690109 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 690109 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 690109 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=45.275390625, floorSegmentMB=1.3447265625, forceMergeDeletesPctAllowed=1.691886395467409, segmentsPerTier=8.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.49222656796644715
   [junit4]   2> 690110 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@4840197b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57169766; maxCacheMB=0.7099609375 maxMergeSizeMB=0.68359375)),segFN=segments_1,generation=1}
   [junit4]   2> 690110 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 690110 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@69394b6e[collection1] main
   [junit4]   2> 690110 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 690111 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 690111 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 690111 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 690112 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 690112 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 690112 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 690112 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 690112 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 690113 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 690117 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/cdcr/state
   [junit4]   2> 690120 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
   [junit4]   2> 690125 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
   [junit4]   2> 690143 INFO  (searcherExecutor-1492-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@69394b6e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 690143 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 690144 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 690144 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 690144 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511473525502771200
   [junit4]   2> 690146 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1511473525502771200
   [junit4]   2> 690146 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 690147 INFO  (coreLoadExecutor-1491-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 690147 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:57230 collection:tmp_collection shard:shard2
   [junit4]   2> 690148 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leader_elect/shard2/election
   [junit4]   2> 690151 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/tmp_collection/leader_elect/shard2/election/94467095224778756-core_node1-n_0000000000
   [junit4]   2> 690151 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard2
   [junit4]   2> 690153 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 690153 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 690153 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"tmp_collection"} current state version: 1
   [junit4]   2> 690153 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57230/collection1/
   [junit4]   2> 690154 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 690154 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:57230/collection1/ has no replicas
   [junit4]   2> 690154 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57230/collection1/ shard2
   [junit4]   2> 690154 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leaders/shard2
   [junit4]   2> 690157 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 690161 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.h.CdcrProcessStateManager Received new leader state @ tmp_collection:shard2
   [junit4]   2> 690164 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:57230",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 690266 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 690269 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:57230/collection1/ and leader is http://127.0.0.1:57230/collection1/
   [junit4]   2> 690269 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57230
   [junit4]   2> 690269 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 690269 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 690269 INFO  (coreZkRegister-1485-thread-1-processing-n:127.0.0.1:57230_ x:collection1 s:shard2 c:tmp_collection r:core_node1) [n:127.0.0.1:57230_ c:tmp_collection s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 690271 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57230",
   [junit4]   2>   "node_name":"127.0.0.1:57230_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 690272 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57230",
   [junit4]   2>   "node_name":"127.0.0.1:57230_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 690374 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 690738 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1
   [junit4]   2> 690739 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 690741 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3aeb8e06{/,null,AVAILABLE}
   [junit4]   2> 690741 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.ServerConnector Started ServerConnector@50ffcf75{HTTP/1.1}{127.0.0.1:57264}
   [junit4]   2> 690741 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.e.j.s.Server Started @694007ms
   [junit4]   2> 690742 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/, hostPort=57264, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores}
   [junit4]   2> 690742 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 690742 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/'
   [junit4]   2> 690757 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 690757 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690759 INFO  (zkCallback-552-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@67cf7bcd name:ZooKeeperConnection Watcher:127.0.0.1:50926/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 690760 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690760 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 690762 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 690762 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/solr.xml
   [junit4]   2> 690767 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores
   [junit4]   2> 690767 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoreContainer New CoreContainer 1866910491
   [junit4]   2> 690767 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/]
   [junit4]   2> 690767 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/lib
   [junit4]   2> 690767 WARN  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/lib).
   [junit4]   2> 690774 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 690775 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 690776 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 690776 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 690776 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:50926/solr
   [junit4]   2> 690776 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 690777 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 690777 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690779 INFO  (zkCallback-554-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1c16b74e name:ZooKeeperConnection Watcher:127.0.0.1:50926 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 690780 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690780 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 690782 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 690785 INFO  (zkCallback-555-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ad6ab26 name:ZooKeeperConnection Watcher:127.0.0.1:50926/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 690785 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 690790 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 691797 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57264_
   [junit4]   2> 691797 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:57264_
   [junit4]   2> 691799 INFO  (zkCallback-555-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 691799 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 691801 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 691801 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94467095224778759-127.0.0.1:57264_-n_0000000001
   [junit4]   2> 691802 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94467095224778756-127.0.0.1:57230_-n_0000000000 to know if I could be the leader
   [junit4]   2> 691815 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 691815 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 691816 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores
   [junit4]   2> 691817 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1, collection=tmp_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 691817 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/
   [junit4]   2> 691818 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 691818 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 691819 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 691819 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 691819 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[81827A3A6340E019]) [n:127.0.0.1:57264_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 691820 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Registering watch for collection tmp_collection
   [junit4]   2> 691820 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch tmp_collection
   [junit4]   2> 691820 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57264",
   [junit4]   2>   "node_name":"127.0.0.1:57264_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 691821 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57264",
   [junit4]   2>   "node_name":"127.0.0.1:57264_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 691821 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for tmp_collection
   [junit4]   2> 691821 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 691821 INFO  (OverseerStateUpdate-94467095224778756-127.0.0.1:57230_-n_0000000000) [n:127.0.0.1:57230_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 691822 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 691923 INFO  (zkCallback-551-thread-1-processing-n:127.0.0.1:57230_) [n:127.0.0.1:57230_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 691923 INFO  (zkCallback-555-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 692823 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 692823 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
   [junit4]   2> 692823 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 692824 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 692824 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 692824 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/'
   [junit4]   2> 692838 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 692843 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 692846 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 692852 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 692853 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 692857 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 692937 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 692938 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 692938 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 692941 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 692963 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 692963 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
   [junit4]   2> 692963 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 692964 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/], dataDir=[null]
   [junit4]   2> 692964 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@773f3290
   [junit4]   2> 692964 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/data
   [junit4]   2> 692965 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/data/index/
   [junit4]   2> 692965 WARN  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 692965 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationDistributedZkTest_81827A3A6340E019-001/jetty-002/cores/collection1/data/index
   [junit4]   2> 692965 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@17822b90
   [junit4]   2> 692966 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@4314eee5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@120e46bf; maxCacheMB=0.7099609375 maxMergeSizeMB=0.68359375)),segFN=segments_1,generation=1}
   [junit4]   2> 692966 INFO  (coreLoadExecutor-1503-thread-1-processing-n:127.0.0.1:57264_) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 692966 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57264_ c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup fo

[...truncated too long message...]

eader_elect/shard2/election/94467241931767816-core_node1-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931768026-127.0.0.1:34491_vxy-n_0000000114
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931768053-127.0.0.1:51765_vxy-n_0000000131
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/94467241931768026-core_node16-n_0000000040
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931768044-127.0.0.1:52109_vxy-n_0000000120
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767819-127.0.0.1:57932_vxy-n_0000000019
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767837-127.0.0.1:55824_vxy-n_0000000025
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767960-127.0.0.1:52448_vxy-n_0000000076
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767930-127.0.0.1:34491_vxy-n_0000000058
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767834-127.0.0.1:51440_vxy-n_0000000129
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931768008-127.0.0.1:52448_vxy-n_0000000100
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767855-127.0.0.1:52109_vxy-n_0000000014
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard2/election/94467241931767840-core_node9-n_0000000004
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/94467241931767930-core_node16-n_0000000020
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767882-127.0.0.1:34491_vxy-n_0000000034
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/94467241931767978-core_node16-n_0000000030
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/94467241931768053-core_node12-n_0000000047
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard2/election/94467241931767834-core_node7-n_0000000003
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard2/election/94467241931768056-core_node11-n_0000000032
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/94467241931767882-core_node16-n_0000000010
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767978-127.0.0.1:34491_vxy-n_0000000090
   [junit4]   2> 	2	/solr/collections/collection1/leader_elect/shard1/election/94467241931767855-core_node14-n_0000000006
   [junit4]   2> 	2	/solr/overseer_elect/election/94467241931767858-127.0.0.1:34560_vxy-n_0000000015
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	88	/solr/collections
   [junit4]   2> 	31	/solr/overseer/collection-queue-work
   [junit4]   2> 	27	/solr/overseer/queue
   [junit4]   2> 	18	/solr/live_nodes
   [junit4]   2> 	16	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=RollingRestartTest -Dtests.method=test -Dtests.seed=81827A3A6340E019 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=nl -Dtests.timezone=Asia/Krasnoyarsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE  581s J0 | RollingRestartTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Unable to restart (#4): CloudJettyRunner [url=http://127.0.0.1:34491/vxy/collection1]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([81827A3A6340E019:9D645E0CDBC8DE1]:0)
   [junit4]    > 	at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
   [junit4]    > 	at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 3507989 INFO  (SUITE-RollingRestartTest-seed#[81827A3A6340E019]-worker) [n:127.0.0.1:34560_vxy c:collection1 s:shard2 r:core_node15 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.RollingRestartTest_81827A3A6340E019-001
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=30450, maxDocsPerChunk=567, blockSize=964), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=30450, blockSize=964)), sim=DefaultSimilarity, locale=nl, timezone=Asia/Krasnoyarsk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=237611776,total=502792192
   [junit4]   2> NOTE: All tests run in this JVM: [CopyFieldTest, DistributedQueryComponentOptimizationTest, PeerSyncTest, TestStandardQParsers, SynonymTokenizerTest, TestOrdValues, TestInitQParser, StandardRequestHandlerTest, HdfsUnloadDistributedZkTest, TestCloudInspectUtil, TestSchemaResource, PingRequestHandlerTest, TestPseudoReturnFields, TestFaceting, IndexSchemaRuntimeFieldTest, TestMacros, TestLuceneMatchVersion, OverseerRolesTest, DateFieldTest, QueryEqualityTest, DistributedFacetPivotLargeTest, SOLR749Test, FileUtilsTest, DeleteShardTest, AlternateDirectoryTest, TestCryptoKeys, TestSolrQueryParserDefaultOperatorResource, TestCollectionAPI, HttpPartitionTest, TestConfigSetImmutable, LeaderElectionIntegrationTest, TestIntervalFaceting, DistributedMLTComponentTest, ExplicitHLLTest, TestValueSourceCache, HdfsBasicDistributedZk2Test, TestTrackingShardHandlerFactory, ExternalFileFieldSortTest, CdcrReplicationDistributedZkTest, DocumentAnalysisRequestHandlerTest, RequestLoggingTest, HighlighterMaxOffsetTest, CollectionStateFormat2Test, TestNamedUpdateProcessors, BasicZkTest, ConnectionManagerTest, ResponseLogComponentTest, FullHLLTest, TestSolrCloudWithKerberosAlt, IndexSchemaTest, DistributedSpellCheckComponentTest, TestRawResponseWriter, TestInfoStreamLogging, CdcrReplicationHandlerTest, TestReplicationHandler, JsonLoaderTest, TestDefaultSearchFieldResource, OpenExchangeRatesOrgProviderTest, TestRandomDVFaceting, TestReplicaProperties, TestLazyCores, TestLMDirichletSimilarityFactory, EchoParamsTest, TestPKIAuthenticationPlugin, TestArbitraryIndexDir, TestPhraseSuggestions, SmileWriterTest, TestDistributedMissingSort, TestConfigSetsAPIZkFailure, BigEndianAscendingWordSerializerTest, TestConfig, SolrRequestParserTest, DistributedQueryElevationComponentTest, TestNonDefinedSimilarityFactory, PathHierarchyTokenizerFactoryTest, SimpleMLTQParserTest, TestIBSimilarityFactory, AnalysisAfterCoreReloadTest, TestDocumentBuilder, ExitableDirectoryReaderTest, TestDistribIDF, TestClassNameShortening, TestOmitPositions, TestSolr4Spatial, TestHdfsUpdateLog, SaslZkACLProviderTest, TestBlobHandler, TestComplexPhraseQParserPlugin, TestInitParams, CursorPagingTest, TestStressLucene, FullSolrCloudDistribCmdsTest, TestRecovery, TestRealTimeGet, TestStressReorder, HardAutoCommitTest, DistributedTermsComponentTest, TestGroupingSearch, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, SuggesterWFSTTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, TestUpdate, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, DebugComponentTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestWriterPerf, TermsComponentTest, DocumentBuilderTest, TestIndexingPerformance, RequiredFieldsTest, TestSolrQueryParser, ReturnFieldsTest, TestCSVResponseWriter, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, TestComponentsName, SearchHandlerTest, TestSolrIndexConfig, BadComponentTest, TestStressRecovery, PrimUtilsTest, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestUtils, ZkNodePropsTest, SliceStateTest, DistributedIntervalFacetingTest, AssignTest, AsyncCallRequestStatusResponseTest, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, DeleteInactiveReplicaTest, DistribCursorPagingTest, MigrateRouteKeyTest, ReplicationFactorTest, RollingRestartTest]
   [junit4] Completed [445/544] on J0 in 581.13s, 1 test, 1 failure <<< FAILURES!

[...truncated 325 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 544 suites, 2141 tests, 1 error, 2 failures, 29 ignored (17 assumptions)

Total time: 183 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 785 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/785/

5 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
shard1 is not consistent.  Got 79 from http://127.0.0.1:49987/_t/e/collection1lastClient and got 68 from http://127.0.0.1:59523/_t/e/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 79 from http://127.0.0.1:49987/_t/e/collection1lastClient and got 68 from http://127.0.0.1:59523/_t/e/collection1
	at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:69F9FBA859143664]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1246)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1225)
	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:165)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


REGRESSION:  org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, _127s.fdx, _127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, _127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, _1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, _1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, _129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, segments_2]}]> but was:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, _127s.fdx, _127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, _127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, _1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, _1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, _129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, segments_2]}, {indexVersion=1441391962566,generation=3,filelist=[_129c.fdt, _129c.fdx, _129c.fnm, _129c.nvd, _129c.nvm, _129c.si, _129c_Lucene50_0.doc, _129c_Lucene50_0.tim, _129c_Lucene50_0.tip, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, segments_3]}]>

Stack Trace:
java.lang.AssertionError: expected:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, _127s.fdx, _127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, _127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, _1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, _1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, _129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, segments_2]}]> but was:<[{indexVersion=1441391962566,generation=2,filelist=[_127s.fdt, _127s.fdx, _127s.fnm, _127s.nvd, _127s.nvm, _127s.si, _127s_Lucene50_0.doc, _127s_Lucene50_0.tim, _127s_Lucene50_0.tip, _1291.cfe, _1291.cfs, _1291.si, _1294.cfe, _1294.cfs, _1294.si, _1295.cfe, _1295.cfs, _1295.si, _1296.cfe, _1296.cfs, _1296.si, _1297.cfe, _1297.cfs, _1297.si, _129b.cfe, _129b.cfs, _129b.si, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, segments_2]}, {indexVersion=1441391962566,generation=3,filelist=[_129c.fdt, _129c.fdx, _129c.fnm, _129c.nvd, _129c.nvm, _129c.si, _129c_Lucene50_0.doc, _129c_Lucene50_0.tim, _129c_Lucene50_0.tip, _12ev.cfe, _12ev.cfs, _12ev.si, _12ew.cfe, _12ew.cfs, _12ew.si, segments_3]}]>
	at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:C47ADF4287A0559F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1138)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.security.BasicAuthIntegrationTest.testBasics

Error Message:
expected:<200> but was:<403>

Stack Trace:
java.lang.AssertionError: expected:<200> but was:<403>
	at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:DC756A5ECF0605EC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.security.BasicAuthIntegrationTest.doExtraTests(BasicAuthIntegrationTest.java:144)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testCollectionCreateSearchDelete(TestMiniSolrCloudClusterBase.java:198)
	at org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testBasics(TestMiniSolrCloudClusterBase.java:79)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=42701, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=42701, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:46308: collection already exists: awholynewstresscollection_collection3_4
	at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=66562, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=66562, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:57124: Could not find collection : awholynewstresscollection_collection0_1
	at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10472 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/init-core-data-001
   [junit4]   2> 1602121 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[E1ADC472F7E85B9C]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1602121 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[E1ADC472F7E85B9C]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1602123 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1602124 INFO  (Thread-37013) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1602124 INFO  (Thread-37013) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1602224 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.ZkTestServer start zk server on port:52477
   [junit4]   2> 1602224 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602225 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602228 INFO  (zkCallback-1009-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7ad63253 name:ZooKeeperConnection Watcher:127.0.0.1:52477 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602228 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1602233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602237 INFO  (zkCallback-1010-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a554a61 name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602237 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602238 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602238 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1602240 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1602241 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1602243 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1602245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1602245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1602248 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1602248 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1602250 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602250 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1602252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1602255 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1602255 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1602258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1602258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1602266 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1602266 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1602268 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1602268 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1602273 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602273 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602278 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1602278 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1602289 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1602290 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1602293 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602299 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602309 INFO  (zkCallback-1011-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57d0a49 name:ZooKeeperConnection Watcher:127.0.0.1:52477 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602309 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602310 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602310 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1602311 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602312 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602313 INFO  (zkCallback-1012-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f453d20 name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602313 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602314 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602314 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1602314 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1602316 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1602316 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1602318 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1602319 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1602320 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602321 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1602323 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1602324 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1602328 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1602329 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1602330 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1602330 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1602332 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1602332 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1602334 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602335 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1602338 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1602338 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1602340 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1602340 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1602343 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1602343 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1602786 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1
   [junit4]   2> 1602789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1602812 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d79e512{/,null,AVAILABLE}
   [junit4]   2> 1602814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4f263076{HTTP/1.1}{127.0.0.1:57975}
   [junit4]   2> 1602814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.Server Started @1605943ms
   [junit4]   2> 1602814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/tempDir-001/control/data, hostContext=/, hostPort=57975, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores}
   [junit4]   2> 1602815 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1602815 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/'
   [junit4]   2> 1602831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602833 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602833 INFO  (zkCallback-1013-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b5398d3 name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602834 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602834 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1602840 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/solr.xml
   [junit4]   2> 1602860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores
   [junit4]   2> 1602860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.CoreContainer New CoreContainer 176170442
   [junit4]   2> 1602863 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/]
   [junit4]   2> 1602863 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/lib
   [junit4]   2> 1602864 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/lib).
   [junit4]   2> 1602871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1602875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1602875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1602875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1602875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52477/solr
   [junit4]   2> 1602876 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1602876 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1602876 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602878 INFO  (zkCallback-1015-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66cfba8 name:ZooKeeperConnection Watcher:127.0.0.1:52477 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1602896 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1602897 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74d4377c name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1602897 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1602899 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1602904 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1602909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1602913 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1602918 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1602920 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1602922 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1602924 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1602926 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1602927 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57975_
   [junit4]   2> 1602928 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:57975_
   [junit4]   2> 1602930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1602932 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1602934 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1602934 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94462968368857094-127.0.0.1:57975_-n_0000000000
   [junit4]   2> 1602935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57975_
   [junit4]   2> 1602935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1602937 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer Overseer (id=94462968368857094-127.0.0.1:57975_-n_0000000000) starting
   [junit4]   2> 1602940 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1602948 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1602948 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1602949 INFO  (OverseerCollectionConfigSetProcessor-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1602950 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1602963 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1602964 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1602964 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores
   [junit4]   2> 1602965 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1602965 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/
   [junit4]   2> 1602965 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1602968 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1602969 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1602969 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [n:127.0.0.1:57975_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1602969 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1602971 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975",
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1602971 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1602972 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975",
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1602973 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1602973 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1602975 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1603972 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1603972 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1603973 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1603973 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1603973 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1603974 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/'
   [junit4]   2> 1603991 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1604007 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1604016 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1604031 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1604033 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1604039 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1604172 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1604179 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1604180 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1604211 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1604216 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1604220 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1604221 WARN  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1604221 WARN  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1604221 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1604223 WARN  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1604223 WARN  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1604224 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1604224 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1604224 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1604224 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1604225 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@509c2215
   [junit4]   2> 1604225 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data
   [junit4]   2> 1604226 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1604226 WARN  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1604226 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/index
   [junit4]   2> 1604227 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=32, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1604227 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@d0a2efe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@183cb0c7),segFN=segments_1,generation=1}
   [junit4]   2> 1604227 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1604228 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/
   [junit4]   2> 1604228 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1604237 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1604238 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1604238 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1604238 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1604238 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1604238 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1604239 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1604240 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1604240 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1604243 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604246 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604262 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604265 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1604273 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1604273 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1604304 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1604304 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1604305 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1604305 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1604308 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=88.2109375, floorSegmentMB=0.5576171875, forceMergeDeletesPctAllowed=3.3935385338130497, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7313505472677709
   [junit4]   2> 1604308 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@d0a2efe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@183cb0c7),segFN=segments_1,generation=1}
   [junit4]   2> 1604308 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1604309 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4a0f2721[collection1] main
   [junit4]   2> 1604309 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1604309 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1604310 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1604310 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1604310 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1604310 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1604311 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1604311 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1604311 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1604311 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1604312 INFO  (searcherExecutor-3667-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4a0f2721[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1604312 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1604312 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1604312 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1604312 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511407496193900544
   [junit4]   2> 1604314 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1511407496193900544
   [junit4]   2> 1604315 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1604316 INFO  (coreLoadExecutor-3666-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1604317 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:57975 collection:control_collection shard:shard1
   [junit4]   2> 1604318 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1604326 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94462968368857094-core_node1-n_0000000000
   [junit4]   2> 1604327 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1604330 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1604330 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1604331 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1604331 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57975/collection1/
   [junit4]   2> 1604331 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1604331 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:57975/collection1/ has no replicas
   [junit4]   2> 1604332 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57975/collection1/ shard1
   [junit4]   2> 1604334 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1604340 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1604345 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:57975",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1604447 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1604448 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:57975/collection1/ and leader is http://127.0.0.1:57975/collection1/
   [junit4]   2> 1604448 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57975
   [junit4]   2> 1604448 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1604448 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1604448 INFO  (coreZkRegister-3660-thread-1-processing-n:127.0.0.1:57975_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57975_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1604452 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975",
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1604453 INFO  (OverseerStateUpdate-94462968368857094-127.0.0.1:57975_-n_0000000000) [n:127.0.0.1:57975_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57975",
   [junit4]   2>   "node_name":"127.0.0.1:57975_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1604470 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1604488 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1604490 INFO  (zkCallback-1018-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e504d4c name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1604490 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1604490 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1604490 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1604493 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1604556 INFO  (zkCallback-1018-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1604556 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:57975_) [n:127.0.0.1:57975_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1605271 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001/cores/collection1
   [junit4]   2> 1605272 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001
   [junit4]   2> 1605275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1605280 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@678f86ea{/,null,AVAILABLE}
   [junit4]   2> 1605280 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6b7c3082{HTTP/1.1}{127.0.0.1:49517}
   [junit4]   2> 1605280 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.e.j.s.Server Started @1608410ms
   [junit4]   2> 1605281 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=49517, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001/cores}
   [junit4]   2> 1605281 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1605281 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_E1ADC472F7E85B9C-001/shard-1-001/'
   [junit4]   2> 1605297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1605297 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1605299 INFO  (zkCallback-1019-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@55b6271 name:ZooKeeperConnection Watcher:127.0.0.1:52477/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1605299 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1605299 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1605300 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E1ADC472F7E85B9C]) [    ] o.

[...truncated too long message...]

ion/leader_elect/shard2/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:336)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:107)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4077203 WARN  (zkCallback-2257-thread-4-processing-n:127.0.0.1:60908_solr) [n:127.0.0.1:60908_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 4077207 INFO  (jetty-launcher-2217-thread-4) [n:127.0.0.1:60908_solr c:testSolrCloudCollection s:shard2 r:core_node1 x:testSolrCloudCollection_shard2_replica2] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@74f56eea{/solr,null,UNAVAILABLE}
   [junit4]   2> 4077211 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[E1ADC472F7E85B9C]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:47492 47492
   [junit4]   2> 4077381 INFO  (Thread-61878) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:47492 47492
   [junit4]   2> 4077383 WARN  (Thread-61878) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/aliases.json
   [junit4]   2> 	9	/solr/security.json
   [junit4]   2> 	6	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/collections/testSolrCloudCollection/state.json
   [junit4]   2> 	3	/solr/overseer_elect/election/94463128016125964-127.0.0.1:44854_solr-n_0000000001
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/collections/testSolrCloudCollection/leader_elect/shard1/election/94463128016125961-core_node2-n_0000000000
   [junit4]   2> 	3	/solr/overseer_elect/election/94463128016125961-127.0.0.1:55346_solr-n_0000000004
   [junit4]   2> 	3	/solr/collections/testSolrCloudCollection/leader_elect/shard2/election/94463128016125962-core_node3-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/94463128016125967-127.0.0.1:50912_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	14	/solr/live_nodes
   [junit4]   2> 	12	/solr/collections
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicAuthIntegrationTest -Dtests.method=testBasics -Dtests.seed=E1ADC472F7E85B9C -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sr_ME_#Latn -Dtests.timezone=EST5EDT -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 39.2s J2 | BasicAuthIntegrationTest.testBasics <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: expected:<200> but was:<403>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E1ADC472F7E85B9C:DC756A5ECF0605EC]:0)
   [junit4]    > 	at org.apache.solr.security.BasicAuthIntegrationTest.doExtraTests(BasicAuthIntegrationTest.java:144)
   [junit4]    > 	at org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testCollectionCreateSearchDelete(TestMiniSolrCloudClusterBase.java:198)
   [junit4]    > 	at org.apache.solr.cloud.TestMiniSolrCloudClusterBase.testBasics(TestMiniSolrCloudClusterBase.java:79)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_E1ADC472F7E85B9C-001
   [junit4]   2> Sep 04, 2015 2:56:23 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=sr_ME_#Latn, timezone=EST5EDT
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=306603720,total=510656512
   [junit4]   2> NOTE: All tests run in this JVM: [UpdateParamsTest, TestSolrDynamicMBean, TestDefaultStatsCache, TestPostingsSolrHighlighter, NoCacheHeaderTest, HdfsBasicDistributedZkTest, TestExactSharedStatsCache, TestScoreJoinQPNoScore, DistributedVersionInfoTest, FieldMutatingUpdateProcessorTest, TestAuthorizationFramework, TestManagedResourceStorage, HdfsSyncSliceTest, OverriddenZkACLAndCredentialsProvidersTest, TestFuzzyAnalyzedSuggestions, TestPerFieldSimilarity, BigEndianAscendingWordDeserializerTest, DocValuesMultiTest, TestSha256AuthenticationProvider, TestSolrDeletionPolicy1, OverseerCollectionConfigSetProcessorTest, TestElisionMultitermQuery, TestZkChroot, TestRandomRequestDistribution, SegmentsInfoRequestHandlerTest, VersionInfoTest, TestSweetSpotSimilarityFactory, TestCloudSchemaless, TestFieldResource, TestCharFilters, TestFieldSortValues, RAMDirectoryFactoryTest, CleanupOldIndexTest, TestDocBasedVersionConstraints, TestSolrCLIRunExample, TestWriterPerf, TestFastWriter, PluginInfoTest, TestLRUStatsCache, DistribJoinFromCollectionTest, SolrCoreCheckLockOnStartupTest, CollectionTooManyReplicasTest, CloudMLTQParserTest, RequestHandlersTest, DistributedQueryComponentCustomSortTest, TestLRUCache, DeleteReplicaTest, CollectionReloadTest, TestMiniSolrCloudCluster, TestCursorMarkWithoutUniqueKey, JavabinLoaderTest, OverseerStatusTest, HardAutoCommitTest, TestExtendedDismaxParser, ClusterStateTest, TestStressReorder, TestSolrXml, TestSmileRequest, DebugComponentTest, TestSearchPerf, TestTrieFacet, AsyncMigrateRouteKeyTest, TestSchemaSimilarityResource, PrimitiveFieldTypeTest, TestCSVResponseWriter, DataDrivenBlockJoinTest, MultiThreadedOCPTest, SuggesterTSTTest, TestCollapseQParserPlugin, DirectUpdateHandlerOptimizeTest, TestCoreDiscovery, SuggesterTest, MigrateRouteKeyTest, BasicDistributedZk2Test, CoreAdminHandlerTest, ZkNodePropsTest, TestBulkSchemaConcurrent, TestSolr4Spatial2, TestGroupingSearch, TestCollationField, TestPHPSerializedResponseWriter, TestIndexSearcher, TestAddFieldRealTimeGet, TestFieldTypeCollectionResource, RecoveryZkTest, QueryParsingTest, TestReloadAndDeleteDocs, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, ShardRoutingTest, TestReplicationHandler, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCloudPivotFacet, TestCollectionAPI, TestConfigSetsAPI, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestReplicaProperties, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, CoreAdminCreateDiscoverTest, SecurityConfHandlerTest, DistributedFacetPivotLargeTest, DistributedQueryComponentOptimizationTest, TestDistributedStatsComponentCardinality, TestSearcherReuse, TestSimpleQParserPlugin, TestStandardQParsers, TestJsonFacets, BasicAuthIntegrationTest]
   [junit4] Completed [518/544] on J2 in 39.52s, 1 test, 1 failure <<< FAILURES!

[...truncated 100 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 544 suites, 2141 tests, 2 errors, 3 failures, 29 ignored (17 assumptions)

Total time: 200 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 784 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/784/

3 tests failed.
REGRESSION:  org.apache.solr.security.BasicAuthIntegrationTest.testBasics

Error Message:
Error from server at http://127.0.0.1:53358/solr: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 401 </title> </head> <body> <h2>HTTP ERROR: 401</h2> <p>Problem accessing /solr/admin/collections. Reason: <pre>    Unauthorized request, Response code: 401</pre></p> <hr /><i><small>Powered by Jetty://</small></i> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53358/solr: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 401 </title>
</head>
<body>
<h2>HTTP ERROR: 401</h2>
<p>Problem accessing /solr/admin/collections. Reason:
<pre>    Unauthorized request, Response code: 401</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([CA580524471D1194:F780AB087FF34FE4]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:528)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.MiniSolrCloudCluster.makeCollectionsRequest(MiniSolrCloudCluster.java:369)
	at org.apache.solr.cloud.MiniSolrCloudCluster.deleteCollection(MiniSolrCloudCluster.java:361)
	at org.apache.solr.cloud.TestMiniSolrCloudCluster.testCollectionCreateSearchDelete(TestMiniSolrCloudCluster.java:210)
	at org.apache.solr.cloud.TestMiniSolrCloudCluster.testBasics(TestMiniSolrCloudCluster.java:87)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:43390: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43390: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:419)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=135735, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=135735, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34327: Could not find collection : awholynewstresscollection_collection0_0
	at __randomizedtesting.SeedInfo.seed([CA580524471D1194]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10110 lines...]
   [junit4] Suite: org.apache.solr.security.BasicAuthIntegrationTest
   [junit4]   2> 1040008 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1040008 INFO  (Thread-7922) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1040009 INFO  (Thread-7922) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1040108 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.ZkTestServer start zk server on port:54983
   [junit4]   2> 1040116 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040117 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040125 INFO  (zkCallback-440-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76a3de91 name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040125 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040125 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040126 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 1040132 INFO  (jetty-launcher-439-thread-1) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1040132 INFO  (jetty-launcher-439-thread-3) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1040134 INFO  (jetty-launcher-439-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2b5c3008{/solr,null,AVAILABLE}
   [junit4]   2> 1040145 INFO  (jetty-launcher-439-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@5aeabe2f{HTTP/1.1}{127.0.0.1:49626}
   [junit4]   2> 1040145 INFO  (jetty-launcher-439-thread-1) [    ] o.e.j.s.Server Started @1043056ms
   [junit4]   2> 1040145 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=49626}
   [junit4]   2> 1040151 INFO  (jetty-launcher-439-thread-2) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1040151 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1040151 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/'
   [junit4]   2> 1040153 INFO  (jetty-launcher-439-thread-4) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1040166 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040169 INFO  (jetty-launcher-439-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c72fa3d{/solr,null,AVAILABLE}
   [junit4]   2> 1040170 INFO  (jetty-launcher-439-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@444e7b66{HTTP/1.1}{127.0.0.1:58344}
   [junit4]   2> 1040170 INFO  (jetty-launcher-439-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ba2e4d2{/solr,null,AVAILABLE}
   [junit4]   2> 1040171 INFO  (jetty-launcher-439-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@6e91b97f{HTTP/1.1}{127.0.0.1:60692}
   [junit4]   2> 1040171 INFO  (jetty-launcher-439-thread-2) [    ] o.e.j.s.Server Started @1043082ms
   [junit4]   2> 1040171 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60692}
   [junit4]   2> 1040171 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1040171 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/'
   [junit4]   2> 1040170 INFO  (jetty-launcher-439-thread-3) [    ] o.e.j.s.Server Started @1043082ms
   [junit4]   2> 1040173 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58344}
   [junit4]   2> 1040174 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1040174 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/'
   [junit4]   2> 1040176 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040186 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040187 INFO  (jetty-launcher-439-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e79a92{/solr,null,AVAILABLE}
   [junit4]   2> 1040188 INFO  (jetty-launcher-439-thread-4) [    ] o.e.j.s.ServerConnector Started ServerConnector@5153200d{HTTP/1.1}{127.0.0.1:39968}
   [junit4]   2> 1040188 INFO  (jetty-launcher-439-thread-4) [    ] o.e.j.s.Server Started @1043099ms
   [junit4]   2> 1040188 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39968}
   [junit4]   2> 1040189 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1040189 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/'
   [junit4]   2> 1040191 INFO  (jetty-launcher-439-thread-5) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1040194 INFO  (jetty-launcher-439-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e35e656{/solr,null,AVAILABLE}
   [junit4]   2> 1040194 INFO  (jetty-launcher-439-thread-5) [    ] o.e.j.s.ServerConnector Started ServerConnector@624c7c4f{HTTP/1.1}{127.0.0.1:44147}
   [junit4]   2> 1040195 INFO  (jetty-launcher-439-thread-5) [    ] o.e.j.s.Server Started @1043106ms
   [junit4]   2> 1040195 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44147}
   [junit4]   2> 1040195 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1040195 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/'
   [junit4]   2> 1040197 INFO  (zkCallback-441-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7632ec14 name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040197 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040197 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040198 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040198 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1040207 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040208 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040208 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040208 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1736455253
   [junit4]   2> 1040209 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/]
   [junit4]   2> 1040209 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib
   [junit4]   2> 1040211 WARN  (jetty-launcher-439-thread-1) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib).
   [junit4]   2> 1040217 INFO  (zkCallback-443-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a9cabbe name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040218 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040218 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040218 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040219 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1040219 INFO  (zkCallback-442-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@659b79f6 name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040219 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040219 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040220 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1040220 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040224 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1040229 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040229 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040230 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040230 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.CoreContainer New CoreContainer 1470787589
   [junit4]   2> 1040230 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/]
   [junit4]   2> 1040230 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib
   [junit4]   2> 1040230 WARN  (jetty-launcher-439-thread-2) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib).
   [junit4]   2> 1040233 INFO  (zkCallback-445-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25bfc843 name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040233 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040233 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040234 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1040238 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1040239 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1040239 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1040239 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54983/solr
   [junit4]   2> 1040239 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1040239 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040239 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040240 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.CoreContainer New CoreContainer 1701707091
   [junit4]   2> 1040240 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/]
   [junit4]   2> 1040240 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib
   [junit4]   2> 1040241 WARN  (jetty-launcher-439-thread-3) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib).
   [junit4]   2> 1040241 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040239 INFO  (zkCallback-444-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1559a738 name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040241 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040242 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1040242 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040242 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1040242 INFO  (zkCallback-447-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@595389e name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040242 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1040243 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1040243 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1040243 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54983/solr
   [junit4]   2> 1040243 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1040243 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040244 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040251 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040244 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040251 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040251 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.CoreContainer New CoreContainer 466000854
   [junit4]   2> 1040251 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/]
   [junit4]   2> 1040251 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib
   [junit4]   2> 1040251 WARN  (jetty-launcher-439-thread-4) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib).
   [junit4]   2> 1040259 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1040260 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040260 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1040261 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1040261 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1040261 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54983/solr
   [junit4]   2> 1040261 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1040261 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1040261 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040263 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040263 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1040263 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.CoreContainer New CoreContainer 2096657347
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/]
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54983/solr
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1040264 INFO  (zkCallback-449-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f82d2b0 name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040264 WARN  (jetty-launcher-439-thread-5) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/lib).
   [junit4]   2> 1040265 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040266 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040265 INFO  (zkCallback-450-thread-1-processing-n:127.0.0.1:49626_solr) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ce0add7 name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040266 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040270 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1040273 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1040273 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1040274 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1040274 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1040274 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1040274 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54983/solr
   [junit4]   2> 1040274 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1040275 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040276 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040264 INFO  (zkCallback-452-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ae49d82 name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040264 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1040284 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040283 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040284 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040284 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040285 INFO  (zkCallback-456-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@21dec9fe name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040285 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040286 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040287 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1040287 INFO  (zkCallback-457-thread-1-processing-n:127.0.0.1:60692_solr) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f7411df name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040288 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040288 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040288 INFO  (zkCallback-454-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32236947 name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040289 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040289 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1040297 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040298 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1040300 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1040301 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1040305 INFO  (zkCallback-458-thread-1-processing-n:127.0.0.1:39968_solr) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@42c2423f name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040305 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040306 INFO  (zkCallback-459-thread-1-processing-n:127.0.0.1:44147_solr) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a890e75 name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040306 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040307 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1040309 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1040312 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1040312 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1040314 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1040315 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1040317 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1040318 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1040320 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1040320 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1040321 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1040322 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1040322 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1040322 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1040323 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49626_solr
   [junit4]   2> 1040323 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44147_solr
   [junit4]   2> 1040323 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60692_solr
   [junit4]   2> 1040324 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49626_solr
   [junit4]   2> 1040324 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44147_solr
   [junit4]   2> 1040324 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60692_solr
   [junit4]   2> 1040325 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39968_solr
   [junit4]   2> 1040329 INFO  (zkCallback-460-thread-1-processing-n:127.0.0.1:58344_solr) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@705c1f1a name:ZooKeeperConnection Watcher:127.0.0.1:54983/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1040329 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1040330 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39968_solr
   [junit4]   2> 1040332 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1040332 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1040334 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1040334 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1040334 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1040336 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1040336 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1040337 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1040337 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94457420479791115-127.0.0.1:60692_solr-n_0000000000
   [junit4]   2> 1040338 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94457420479791117-127.0.0.1:39968_solr-n_0000000001
   [junit4]   2> 1040338 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94457420479791112-127.0.0.1:49626_solr-n_0000000002
   [junit4]   2> 1040339 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60692_solr
   [junit4]   2> 1040339 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1040340 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94457420479791115-127.0.0.1:60692_solr-n_0000000000 to know if I could be the leader
   [junit4]   2> 1040340 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1040340 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94457420479791117-127.0.0.1:39968_solr-n_0000000001 to know if I could be the leader
   [junit4]   2> 1040341 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1040341 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1040344 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94457420479791118-127.0.0.1:44147_solr-n_0000000003
   [junit4]   2> 1040344 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.Overseer Overseer (id=94457420479791115-127.0.0.1:60692_solr-n_0000000000) starting
   [junit4]   2> 1040347 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94457420479791112-127.0.0.1:49626_solr-n_0000000002 to know if I could be the leader
   [junit4]   2> 1040347 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1040366 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1040388 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1040395 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1040395 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1040398 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040399 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.c.CoresLocator Found 0 core definitions
   [junit4]   2> 1040407 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1040407 INFO  (jetty-launcher-439-thread-1) [n:127.0.0.1:49626_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1040409 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1040409 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1040409 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1040409 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1040409 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1040410 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040410 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040410 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.c.CoresLocator Found 0 core definitions
   [junit4]   2> 1040410 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.c.CoresLocator Found 0 core definitions
   [junit4]   2> 1040412 INFO  (OverseerCollectionConfigSetProcessor-94457420479791115-127.0.0.1:60692_solr-n_0000000000) [n:127.0.0.1:60692_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1040412 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1040413 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1040413 INFO  (jetty-launcher-439-thread-4) [n:127.0.0.1:39968_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1040414 INFO  (OverseerStateUpdate-94457420479791115-127.0.0.1:60692_solr-n_0000000000) [n:127.0.0.1:60692_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1040414 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1040414 INFO  (jetty-launcher-439-thread-5) [n:127.0.0.1:44147_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1040429 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1040429 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1040430 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1040431 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.c.CoresLocator Found 0 core definitions
   [junit4]   2> 1040433 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1040434 INFO  (jetty-launcher-439-thread-2) [n:127.0.0.1:60692_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1041405 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58344_solr
   [junit4]   2> 1041406 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58344_solr
   [junit4]   2> 1041408 INFO  (zkCallback-457-thread-1-processing-n:127.0.0.1:60692_solr) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1041408 INFO  (zkCallback-460-thread-1-processing-n:127.0.0.1:58344_solr) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1041408 INFO  (zkCallback-450-thread-1-processing-n:127.0.0.1:49626_solr) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1041408 INFO  (zkCallback-458-thread-1-processing-n:127.0.0.1:39968_solr) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1041408 INFO  (zkCallback-459-thread-1-processing-n:127.0.0.1:44147_solr) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1041412 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1041413 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94457420479791119-127.0.0.1:58344_solr-n_0000000004
   [junit4]   2> 1041414 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94457420479791118-127.0.0.1:44147_solr-n_0000000003 to know if I could be the leader
   [junit4]   2> 1041424 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1041424 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1041425 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-001/.
   [junit4]   2> 1041426 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.c.CoresLocator Found 0 core definitions
   [junit4]   2> 1041427 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1041427 INFO  (jetty-launcher-439-thread-3) [n:127.0.0.1:58344_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1041427 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1041428 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1041429 INFO  (zkCallback-461-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b448733 name:ZooKeeperConnection Watcher:127.0.0.1:54983 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1041429 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1041430 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1041432 INFO  (jetty-launcher-439-thread-4) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@6e91b97f{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1041434 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1470787589
   [junit4]   2> 1041441 INFO  (jetty-launcher-439-thread-5) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@624c7c4f{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1041441 INFO  (jetty-launcher-439-thread-5) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2096657347
   [junit4]   2> 1041441 INFO  (jetty-launcher-439-thread-3) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@5aeabe2f{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1041442 INFO  (jetty-launcher-439-thread-3) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1736455253
   [junit4]   2> 1041450 INFO  (jetty-launcher-439-thread-2) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@5153200d{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1041450 INFO  (jetty-launcher-439-thread-1) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@444e7b66{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1041451 INFO  (jetty-launcher-439-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=466000854
   [junit4]   2> 1041451 INFO  (jetty-launcher-439-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1701707091
   [junit4]   2> 1041452 INFO  (zkCallback-457-thread-1-processing-n:127.0.0.1:60692_solr) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1041452 INFO  (zkCallback-459-thread-1-processing-n:127.0.0.1:44147_solr) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1041452 INFO  (zkCallback-458-thread-1-processing-n:127.0.0.1:39968_solr) [n:127.0.0.1:39968_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1041453 INFO  (zkCallback-450-thread-1-processing-n:127.0.0.1:49626_solr) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1041453 INFO  (jetty-launcher-439-thread-4) [    ] o.a.s.c.Overseer Overseer (id=94457420479791115-127.0.0.1:60692_solr-n_0000000000) closing
   [junit4]   2> 1041457 INFO  (zkCallback-460-thread-2-processing-n:127.0.0.1:58344_solr) [n:127.0.0.1:58344_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1041457 INFO  (OverseerStateUpdate-94457420479791115-127.0.0.1:60692_solr-n_0000000000) [n:127.0.0.1:60692_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:60692_solr
   [junit4]   2> 1041460 INFO  (zkCallback-457-thread-1-processing-n:127.0.0.1:60692_solr) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1041460 WARN  (zkCallback-460-thread-1-processing-n:127.0.0.1:58344_solr) [n:127.0.0.1:58344_solr    ] o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election/94457420479791117-127.0.0.1:39968_solr-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:181)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1041465 ERROR (jetty-launcher-439-thread-4-EventThread) [n:127.0.0.1:39968_solr    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@745813fe rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@315a9311[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 3]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1041465 ERROR (jetty-launcher-439-thread-3-EventThread) [n:127.0.0.1:58344_solr    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@696127cf rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@11b8f4cb[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 3]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1041468 INFO  (jetty-launcher-439-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1c72fa3d{/solr,null,UNAVAILABLE}
   [junit4]   2> 1042953 WARN  (zkCallback-459-thread-1-processing-n:127.0.0.1:44147_solr) [n:127.0.0.1:44147_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1042953 WARN  (zkCallback-450-thread-1-processing-n:127.0.0.1:49626_solr) [n:127.0.0.1:49626_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1042953 INFO  (jetty-launcher-439-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e35e656{/solr,null,UNAVAILABLE}
   [junit4]   2> 1042955 INFO  (jetty-launcher-439-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2b5c3008{/solr,null,UNAVAILABLE}
   [junit4]   2> 1042960 WARN  (zkCallback-457-thread-1-processing-n:127.0.0.1:60692_solr) [n:127.0.0.1:60692_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1042960 WARN  (zkCallback-458-thread-1-processing-n:127.0.0.1:39968_solr) [n:127.0.0.1:39968_solr    ] o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:336)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:333)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:107)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:58)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:388)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1042962 INFO  (jetty-launcher-439-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5ba2e4d2{/solr,null,UNAVAILABLE}
   [junit4]   2> 1042964 INFO  (jetty-launcher-439-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e79a92{/solr,null,UNAVAILABLE}
   [junit4]   2> 1042969 INFO  (TEST-BasicAuthIntegrationTest.testExraFilters-seed#[CA580524471D1194]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54983 54983
   [junit4]   2> 1043378 INFO  (Thread-7922) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54983 54983
   [junit4]   2> 1043382 WARN  (Thread-7922) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1043391 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1043392 INFO  (Thread-7982) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1043392 INFO  (Thread-7982) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1043492 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.ZkTestServer start zk server on port:50687
   [junit4]   2> 1043492 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1043493 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1043501 INFO  (zkCallback-464-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@42b56d9b name:ZooKeeperConnection Watcher:127.0.0.1:50687 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1043501 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1043501 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1043502 INFO  (TEST-BasicAuthIntegrationTest.testBasics-seed#[CA580524471D1194]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 1043513 INFO  (jetty-launcher-463-thread-1) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1043513 INFO  (jetty-launcher-463-thread-5) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1043514 INFO  (jetty-launcher-463-thread-4) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1043514 INFO  (jetty-launcher-463-thread-3) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1043515 INFO  (jetty-launcher-463-thread-2) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1043517 INFO  (jetty-launcher-463-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33518de7{/solr,null,AVAILABLE}
   [junit4]   2> 1043517 INFO  (jetty-launcher-463-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72b5d739{/solr,null,AVAILABLE}
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@349c37c5{HTTP/1.1}{127.0.0.1:35014}
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-1) [    ] o.e.j.s.Server Started @1046429ms
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-5) [    ] o.e.j.s.ServerConnector Started ServerConnector@7c11b1c4{HTTP/1.1}{127.0.0.1:53358}
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35014}
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-5) [    ] o.e.j.s.Server Started @1046429ms
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/'
   [junit4]   2> 1043518 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53358}
   [junit4]   2> 1043521 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1043521 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/'
   [junit4]   2> 1043530 INFO  (jetty-launcher-463-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@67eb9514{/solr,null,AVAILABLE}
   [junit4]   2> 1043531 INFO  (jetty-launcher-463-thread-4) [    ] o.e.j.s.ServerConnector Started ServerConnector@260a5b1e{HTTP/1.1}{127.0.0.1:52193}
   [junit4]   2> 1043531 INFO  (jetty-launcher-463-thread-4) [    ] o.e.j.s.Server Started @1046442ms
   [junit4]   2> 1043531 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52193}
   [junit4]   2> 1043531 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1043531 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/'
   [junit4]   2> 1043533 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1043533 INFO  (jetty-launcher-463-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1dbb777f{/solr,null,AVAILABLE}
   [junit4]   2> 1043534 INFO  (jetty-launcher-463-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@51b961a8{HTTP/1.1}{127.0.0.1:40595}
   [junit4]   2> 1043534 INFO  (jetty-launcher-463-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@83978c0{/solr,null,AVAILABLE}
   [junit4]   2> 1043534 INFO  (jetty-launcher-463-thread-3) [    ] o.e.j.s.Server Started @1046445ms
   [junit4]   2> 1043534 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40595}
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@d86b376{HTTP/1.1}{127.0.0.1:46668}
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-2) [    ] o.e.j.s.Server Started @1046446ms
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46668}
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/'
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1043535 INFO  (jetty-launcher-463-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/'
   [junit4]   2> 1043541 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1043545 INFO  (zkCallback-465-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@60948da6 name:ZooKeeperConnection Watcher:127.0.0.1:50687/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1043546 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1043546 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1043546 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1043552 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/.
   [junit4]   2> 1043552 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.CoreContainer New CoreContainer 316024297
   [junit4]   2> 1043553 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/]
   [junit4]   2> 1043553 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/lib
   [junit4]   2> 1043553 WARN  (jetty-launcher-463-thread-5) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/lib).
   [junit4]   2> 1043554 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1043557 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1043562 INFO  (zkCallback-466-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14610468 name:ZooKeeperConnection Watcher:127.0.0.1:50687/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1043562 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1043563 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1043563 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1043569 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/.
   [junit4]   2> 1043569 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1466920358
   [junit4]   2> 1043569 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/]
   [junit4]   2> 1043569 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/lib
   [junit4]   2> 1043569 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1043569 WARN  (jetty-launcher-463-thread-1) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.security.BasicAuthIntegrationTest_CA580524471D1194-001/tempDir-002/lib).
   [junit4]   2> 1043570 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1043572 INFO  (zkCallback-467-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5de1a60 name:ZooKeeperConnection Watcher:127.0.0.1:50687/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1043574 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1043577 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1043577 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1043578 INFO  (jetty-launcher-463-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1043596 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1043599 INFO  (zkCallback-468-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11fb5cb9 name:ZooKeeperConnection Watcher:127.0.0.1:50687/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1043602 INFO  (jetty-launcher-463-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1043604 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1043604 INFO  (jetty-launcher-463-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1043604 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1043603 INFO  (jetty-launcher-463-thread-5) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1043605 INFO  (jetty-launcher-463-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:

[...truncated too long message...]

   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17811, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43390: Could not find collection : awholynewstresscollection_collection5_2
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CA580524471D1194]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17809, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43390: Could not find collection : awholynewstresscollection_collection3_2
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CA580524471D1194]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17807, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53382: Could not find collection : awholynewstresscollection_collection1_3
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CA580524471D1194]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
   [junit4]   2> 2822961 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[CA580524471D1194]-worker) [n:127.0.0.1:53382_ c:awholynewstresscollection_collection1_3 s:shard2 r:core_node29 x:awholynewstresscollection_collection1_3_shard2_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_CA580524471D1194-001
   [junit4]   2> Sep 03, 2015 3:13:57 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene53, sim=DefaultSimilarity, locale=iw, timezone=Africa/Porto-Novo
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=56625920,total=513802240
   [junit4]   2> NOTE: All tests run in this JVM: [ReplicationFactorTest, TestFieldCollectionResource, AnalysisAfterCoreReloadTest, DeleteLastCustomShardedReplicaTest, TestInitQParser, TestMergePolicyConfig, QueryElevationComponentTest, LeaderElectionIntegrationTest, DistributedSpellCheckComponentTest, PeerSyncTest, TestRangeQuery, DistributedQueryComponentOptimizationTest, ConcurrentDeleteAndCreateCollectionTest, TestJoin, LeaderInitiatedRecoveryOnCommitTest, DistributedFacetPivotLargeTest, OutputWriterTest, CopyFieldTest, HttpPartitionTest, TestSortByMinMaxFunction, TestHdfsUpdateLog, TestPivotHelperCode, TestSolrConfigHandlerConcurrent, TestFaceting, AliasIntegrationTest, TestBinaryField, TestRealTimeGet, TestPKIAuthenticationPlugin, TestRecoveryHdfs, TestSerializedLuceneMatchVersion, TestJsonRequest, RequestLoggingTest, TestStandardQParsers, PingRequestHandlerTest, SolrTestCaseJ4Test, DisMaxRequestHandlerTest, StandardRequestHandlerTest, ActionThrottleTest, TestCSVLoader, TestDistributedMissingSort, TestSimpleQParserPlugin, EnumFieldTest, UUIDUpdateProcessorFallbackTest, TestCloudManagedSchemaConcurrent, TestDistribIDF, HdfsBasicDistributedZk2Test, TestLuceneMatchVersion, OpenExchangeRatesOrgProviderTest, TestClusterStateMutator, ZkStateWriterTest, SOLR749Test, JsonLoaderTest, TestRestManager, TestRandomMergePolicy, TestEmbeddedSolrServerConstructors, SolrXmlInZkTest, SolrRequestParserTest, CollectionStateFormat2Test, TestDynamicFieldResource, TestRandomDVFaceting, TestDownShardTolerantSearch, DefaultValueUpdateProcessorTest, HdfsUnloadDistributedZkTest, TestTrackingShardHandlerFactory, SaslZkACLProviderTest, RankQueryTest, CursorPagingTest, TestRemoteStreaming, ResourceLoaderTest, TestDocSet, DateFieldTest, CollectionsAPIAsyncDistributedZkTest, CoreAdminCreateDiscoverTest, TestBadConfig, PathHierarchyTokenizerFactoryTest, FileUtilsTest, QueryEqualityTest, TestRandomFaceting, TestArbitraryIndexDir, TestManagedSchemaFieldResource, TestComplexPhraseQParserPlugin, DistributedFacetPivotSmallTest, PolyFieldTest, DeleteInactiveReplicaTest, BigEndianAscendingWordSerializerTest, TestPseudoReturnFields, TestInitParams, SignatureUpdateProcessorFactoryTest, HighlighterMaxOffsetTest, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [407/543] on J0 in 1032.90s, 1 test, 1 error <<< FAILURES!

[...truncated 459 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 543 suites, 2147 tests, 3 errors, 29 ignored (17 assumptions)

Total time: 189 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 783 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/783/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=12089, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=12089, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33597/xmmr/y: Could not find collection : awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([7054EE2856A2078B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=13262, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13262, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45637: Could not find collection : awholynewstresscollection_collection0_0
	at __randomizedtesting.SeedInfo.seed([7054EE2856A2078B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10399 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/init-core-data-001
   [junit4]   2> 1910012 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[7054EE2856A2078B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1910013 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[7054EE2856A2078B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /xmmr/y
   [junit4]   2> 1910019 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1910019 INFO  (Thread-7846) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1910021 INFO  (Thread-7846) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1910119 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ZkTestServer start zk server on port:48212
   [junit4]   2> 1910119 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1910120 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1910124 INFO  (zkCallback-612-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5806a1ba name:ZooKeeperConnection Watcher:127.0.0.1:48212 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1910124 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1910124 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1910124 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1910129 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1910130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1910134 INFO  (zkCallback-613-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ba0cb56 name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1910134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1910134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1910134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1910138 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1910140 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1910142 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1910146 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1910146 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1910150 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1910151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1910156 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1910156 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1910159 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1910159 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1910162 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1910163 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1910165 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1910166 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1910169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1910169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1910172 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1910172 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1910176 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1910177 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1910181 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1910181 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1910184 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1910185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1910596 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1
   [junit4]   2> 1910600 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1910603 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1b86104{/xmmr/y,null,AVAILABLE}
   [junit4]   2> 1910609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3946260c{HTTP/1.1}{127.0.0.1:35971}
   [junit4]   2> 1910609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.Server Started @1914150ms
   [junit4]   2> 1910609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/tempDir-001/control/data, hostContext=/xmmr/y, hostPort=35971, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores}
   [junit4]   2> 1910610 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1910610 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/'
   [junit4]   2> 1910627 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1910629 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1910640 INFO  (zkCallback-614-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@c48636a name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1910641 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1910641 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1910648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1910648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/solr.xml
   [junit4]   2> 1910653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores
   [junit4]   2> 1910653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoreContainer New CoreContainer 1556268113
   [junit4]   2> 1910653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/]
   [junit4]   2> 1910653 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/lib
   [junit4]   2> 1910653 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/lib).
   [junit4]   2> 1910678 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1910679 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1910680 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1910682 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1910682 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48212/solr
   [junit4]   2> 1910682 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1910682 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1910683 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1910690 INFO  (zkCallback-616-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@ba210bf name:ZooKeeperConnection Watcher:127.0.0.1:48212 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1910691 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1910691 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1910698 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1910699 INFO  (zkCallback-617-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@431da9f5 name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1910700 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1910702 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1910706 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1910710 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1910712 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1910716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1910723 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1910725 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1910731 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1910734 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1910741 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35971_xmmr%2Fy
   [junit4]   2> 1910742 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35971_xmmr%2Fy
   [junit4]   2> 1910752 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1910754 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1910755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1910756 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000
   [junit4]   2> 1910756 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35971_xmmr%2Fy
   [junit4]   2> 1910756 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1910757 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer Overseer (id=94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) starting
   [junit4]   2> 1910759 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1910770 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1910771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1910771 INFO  (OverseerCollectionConfigSetProcessor-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1910771 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1910794 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1910795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1910795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores
   [junit4]   2> 1910796 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1910797 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/
   [junit4]   2> 1910797 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1910799 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 1910800 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1910801 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1910801 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1910809 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35971/xmmr/y",
   [junit4]   2>   "node_name":"127.0.0.1:35971_xmmr%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1910809 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35971/xmmr/y",
   [junit4]   2>   "node_name":"127.0.0.1:35971_xmmr%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1910810 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1910810 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1910811 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1910812 INFO  (zkCallback-617-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1911812 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1911813 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1911813 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1911813 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1911818 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1911818 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/'
   [junit4]   2> 1911837 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1911845 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1911849 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1911860 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1911862 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1911866 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1911970 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1911975 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1911976 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1911988 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1911990 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1911993 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1911994 WARN  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1911994 WARN  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1911994 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1911995 WARN  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1911995 WARN  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1911996 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 1911996 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1911996 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1911997 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1911997 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@299d5ac0
   [junit4]   2> 1911997 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/data
   [junit4]   2> 1911998 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1911998 WARN  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1911998 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/data/index
   [junit4]   2> 1911998 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=82.640625, floorSegmentMB=1.8916015625, forceMergeDeletesPctAllowed=29.841714198289385, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7519293534578809
   [junit4]   2> 1911999 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@52164bb7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b108073),segFN=segments_1,generation=1}
   [junit4]   2> 1911999 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1911999 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/data/
   [junit4]   2> 1912000 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1912004 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1912004 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1912004 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1912005 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1912005 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1912005 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1912007 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1912007 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1912007 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1912010 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1912011 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1912012 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1912014 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1912018 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1912018 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1912019 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1912020 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1912020 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1912021 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1912021 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1912022 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@52164bb7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b108073),segFN=segments_1,generation=1}
   [junit4]   2> 1912022 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1912022 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5fad063b[collection1] main
   [junit4]   2> 1912022 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1912025 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1912025 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1912026 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1912026 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1912026 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1912027 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1912027 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1912027 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1912027 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1912028 INFO  (searcherExecutor-3327-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5fad063b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1912028 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1912028 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1912028 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1912028 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511196401606852608
   [junit4]   2> 1912030 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1511196401606852608
   [junit4]   2> 1912030 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1912031 INFO  (coreLoadExecutor-3326-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1912032 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:35971/xmmr/y collection:control_collection shard:shard1
   [junit4]   2> 1912032 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1912037 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94449774969159684-core_node1-n_0000000000
   [junit4]   2> 1912040 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1912043 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1912043 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1912044 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1912044 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35971/xmmr/y/collection1/
   [junit4]   2> 1912044 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1912044 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:35971/xmmr/y/collection1/ has no replicas
   [junit4]   2> 1912044 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35971/xmmr/y/collection1/ shard1
   [junit4]   2> 1912045 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1912050 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1912054 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:35971/xmmr/y",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1912156 INFO  (zkCallback-617-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1912206 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:35971/xmmr/y/collection1/ and leader is http://127.0.0.1:35971/xmmr/y/collection1/
   [junit4]   2> 1912206 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35971/xmmr/y
   [junit4]   2> 1912207 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1912207 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1912207 INFO  (coreZkRegister-3320-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35971_xmmr%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1912209 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35971/xmmr/y",
   [junit4]   2>   "node_name":"127.0.0.1:35971_xmmr%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1912210 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35971/xmmr/y",
   [junit4]   2>   "node_name":"127.0.0.1:35971_xmmr%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1912301 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1912303 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912304 INFO  (zkCallback-619-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5dcfc788 name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912304 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1912304 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1912304 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1912306 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1912306 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1912307 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1912307 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912310 INFO  (zkCallback-620-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c1bd140 name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912311 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1912311 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1912312 INFO  (zkCallback-617-thread-1-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1912313 INFO  (zkCallback-619-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1912326 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 1912326 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1912432 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1912711 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores/collection1
   [junit4]   2> 1912712 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001
   [junit4]   2> 1912712 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1912716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39149dc3{/xmmr/y,null,AVAILABLE}
   [junit4]   2> 1912716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@49e9c363{HTTP/1.1}{127.0.0.1:59987}
   [junit4]   2> 1912716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.e.j.s.Server Started @1916257ms
   [junit4]   2> 1912716 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/xmmr/y, hostPort=59987, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores}
   [junit4]   2> 1912717 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1912717 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/'
   [junit4]   2> 1912732 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1912738 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912738 INFO  (zkCallback-621-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@34cd20e3 name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912738 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1912738 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1912740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1912740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/solr.xml
   [junit4]   2> 1912745 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores
   [junit4]   2> 1912745 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoreContainer New CoreContainer 578612396
   [junit4]   2> 1912745 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/]
   [junit4]   2> 1912746 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/lib
   [junit4]   2> 1912746 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/lib).
   [junit4]   2> 1912753 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1912754 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1912755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1912755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1912755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48212/solr
   [junit4]   2> 1912755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1912755 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1912757 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912759 INFO  (zkCallback-623-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66cce05b name:ZooKeeperConnection Watcher:127.0.0.1:48212 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912761 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1912761 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1912766 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912768 INFO  (zkCallback-624-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@494939d3 name:ZooKeeperConnection Watcher:127.0.0.1:48212/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912768 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1912785 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1913804 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59987_xmmr%2Fy
   [junit4]   2> 1913804 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59987_xmmr%2Fy
   [junit4]   2> 1913807 INFO  (zkCallback-617-thread-2-processing-n:127.0.0.1:35971_xmmr%2Fy) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1913807 INFO  (zkCallback-624-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1913807 INFO  (zkCallback-619-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1913810 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1913812 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94449774969159689-127.0.0.1:59987_xmmr%2Fy-n_0000000001
   [junit4]   2> 1913812 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000 to know if I could be the leader
   [junit4]   2> 1913826 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1913826 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1913826 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores
   [junit4]   2> 1913827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1913827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores/collection1/
   [junit4]   2> 1913827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1913829 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 1913829 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[7054EE2856A2078B]) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1913831 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1913832 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1913835 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:59987/xmmr/y",
   [junit4]   2>   "node_name":"127.0.0.1:59987_xmmr%2Fy",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 1913835 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 1913835 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 1913835 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:59987/xmmr/y",
   [junit4]   2>   "node_name":"127.0.0.1:59987_xmmr%2Fy",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1913835 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 1913836 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0 
   [junit4]   2> 1913836 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1913836 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1913939 INFO  (OverseerStateUpdate-94449774969159684-127.0.0.1:35971_xmmr%2Fy-n_0000000000) [n:127.0.0.1:35971_xmmr%2Fy    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 1913939 INFO  (zkCallback-624-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1913940 INFO  (zkCallback-624-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy    ] o.a.s.c.c.ZkStateReader Updating data for collection1 from 0 to 1 
   [junit4]   2> 1914836 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1914836 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 1914837 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1914837 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
   [junit4]   2> 1914839 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1914839 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest_7054EE2856A2078B-001/shard-1-001/cores/collection1/'
   [junit4]   2> 1914872 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1914879 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1914883 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1914891 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1914892 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1914897 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1914987 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1914992 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1914993 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1915001 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1915003 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1915005 INFO  (coreLoadExecutor-3337-thread-1-processing-n:127.0.0.1:59987_xmmr%2Fy) [n:127.0.0.1:59987_xmmr%2Fy c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1915005 WARN  (coreLoadExecutor-3337-thread-1-processing-n:127.0

[...truncated too long message...]

ceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 2382820 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[7054EE2856A2078B]-worker) [n:127.0.0.1:45637_ c:addReplicaColl s:shard2 r:core_node6 x:addReplicaColl_shard2_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 02, 2015 6:27:46 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=PostingsFormat(name=Asserting), range_facet_l_dv=PostingsFormat(name=LuceneVarGapDocFreqInterval), _version_=PostingsFormat(name=Asserting), multiDefault=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=Asserting), a_i1=PostingsFormat(name=Asserting), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), range_facet_i_dv=PostingsFormat(name=Asserting), text=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Lucene50), timestamp=DocValuesFormat(name=Lucene50)}, sim=DefaultSimilarity, locale=no_NO, timezone=Pacific/Wallis
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=149442480,total=535822336
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrIndexConfig, DocValuesMultiTest, TestReversedWildcardFilterFactory, BinaryUpdateRequestHandlerTest, RequestHandlersTest, TestRandomRequestDistribution, TestFieldSortValues, ResponseHeaderTest, TestFieldTypeCollectionResource, UpdateParamsTest, DebugComponentTest, CdcrVersionReplicationTest, TestManagedStopFilterFactory, TestReload, TestOrdValues, HdfsThreadLeakTest, RegexBoostProcessorTest, TestSolrCLIRunExample, TestIndexSearcher, TestCollectionAPI, TestDefaultSimilarityFactory, TestCollapseQParserPlugin, TestReRankQParserPlugin, TestDynamicFieldCollectionResource, BigEndianAscendingWordDeserializerTest, TestDocBasedVersionConstraints, FullSolrCloudDistribCmdsTest, SystemInfoHandlerTest, SampleTest, AssignTest, CursorMarkTest, MigrateRouteKeyTest, HdfsDirectoryFactoryTest, TestDefaultSearchFieldResource, AnalyticsMergeStrategyTest, TestSolrCloudWithKerberosAlt, CdcrReplicationDistributedZkTest, TestSmileRequest, TestNamedUpdateProcessors, TestSolr4Spatial2, TestRecovery, DirectUpdateHandlerTest, StatsComponentTest, TestFuzzyAnalyzedSuggestions, CloudMLTQParserTest, TestStressReorder, TestFieldResource, TestSweetSpotSimilarityFactory, TestTrieFacet, TestCollationField, SuggesterTest, SegmentsInfoRequestHandlerTest, DistributedDebugComponentTest, SimpleFacetsTest, TestMinMaxOnMultiValuedField, TestScoreJoinQPNoScore, ExplicitHLLTest, LeaderElectionTest, LukeRequestHandlerTest, OverseerCollectionConfigSetProcessorTest, HighlighterConfigTest, QueryParsingTest, DistributedFacetPivotSmallAdvancedTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [246/543] on J2 in 1199.19s, 1 test, 1 error <<< FAILURES!

[...truncated 934 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 543 suites, 2146 tests, 2 errors, 29 ignored (17 assumptions)

Total time: 196 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 782 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/782/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=3732, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3732, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34748: Could not find collection : awholynewstresscollection_collection0_2
	at __randomizedtesting.SeedInfo.seed([30C37AFE985C4B24]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=31433, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=31433, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:55220/g_ju: Could not find collection : awholynewstresscollection_collection5_0
	at __randomizedtesting.SeedInfo.seed([30C37AFE985C4B24]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 9767 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/init-core-data-001
   [junit4]   2> 393404 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[30C37AFE985C4B24]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 393404 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[30C37AFE985C4B24]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 393409 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 393409 INFO  (Thread-1149) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 393409 INFO  (Thread-1149) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 393509 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ZkTestServer start zk server on port:35335
   [junit4]   2> 393510 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 393511 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 393517 INFO  (zkCallback-360-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3420f7da name:ZooKeeperConnection Watcher:127.0.0.1:35335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 393517 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 393517 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 393517 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 393519 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 393520 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 393521 INFO  (zkCallback-361-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@630989c8 name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 393521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 393521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 393521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 393523 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 393525 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 393532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 393533 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 393534 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 393536 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 393536 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 393538 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 393538 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 393541 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 393541 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 393542 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 393543 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 393544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 393544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 393552 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 393552 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 393554 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 393554 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 393556 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 393556 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 393558 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 393558 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 393559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 393559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 393562 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 393570 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 393579 INFO  (zkCallback-362-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@49bd884c name:ZooKeeperConnection Watcher:127.0.0.1:35335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 393579 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 393580 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 393580 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 393583 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 393587 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 393589 INFO  (zkCallback-363-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@21f85e8e name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 393589 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 393589 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 393590 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 393590 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 393594 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 393595 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 393598 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 393599 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 393600 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 393600 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 393602 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 393602 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 393604 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 393604 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 393605 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 393606 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 393609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 393609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 393610 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 393610 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 393612 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 393612 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 393614 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 393614 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 393615 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 393615 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 394033 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1
   [junit4]   2> 394041 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 394072 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35cf3341{/,null,AVAILABLE}
   [junit4]   2> 394073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.ServerConnector Started ServerConnector@7cb82d36{HTTP/1.1}{127.0.0.1:42527}
   [junit4]   2> 394073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.Server Started @397504ms
   [junit4]   2> 394073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/tempDir-001/control/data, hostContext=/, hostPort=42527, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores}
   [junit4]   2> 394074 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 394074 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/'
   [junit4]   2> 394089 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 394091 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394099 INFO  (zkCallback-364-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6feb3659 name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 394099 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394100 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 394101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 394101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/solr.xml
   [junit4]   2> 394107 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores
   [junit4]   2> 394107 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoreContainer New CoreContainer 968112429
   [junit4]   2> 394107 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/]
   [junit4]   2> 394108 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/lib
   [junit4]   2> 394108 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/lib).
   [junit4]   2> 394115 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 394117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 394117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 394117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 394117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35335/solr
   [junit4]   2> 394118 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 394118 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 394123 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394127 INFO  (zkCallback-366-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3307ecec name:ZooKeeperConnection Watcher:127.0.0.1:35335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 394130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 394140 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 394144 INFO  (zkCallback-367-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2bba40dd name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 394144 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 394145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 394147 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 394150 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 394151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 394153 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 394155 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 394157 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 394158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 394160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 394162 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42527_
   [junit4]   2> 394162 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42527_
   [junit4]   2> 394164 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 394167 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 394168 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 394169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94444131236184070-127.0.0.1:42527_-n_0000000000
   [junit4]   2> 394169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42527_
   [junit4]   2> 394169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 394173 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer Overseer (id=94444131236184070-127.0.0.1:42527_-n_0000000000) starting
   [junit4]   2> 394175 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 394180 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 394189 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 394190 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 394191 INFO  (OverseerCollectionConfigSetProcessor-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 394202 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 394225 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 394225 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 394226 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores
   [junit4]   2> 394227 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 394227 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/
   [junit4]   2> 394227 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 394232 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 394232 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 394235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 394235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:42527_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 394236 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42527",
   [junit4]   2>   "node_name":"127.0.0.1:42527_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 394237 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42527",
   [junit4]   2>   "node_name":"127.0.0.1:42527_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 394237 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 394237 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 394238 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 394239 INFO  (zkCallback-367-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 394243 INFO  (zkCallback-367-thread-2-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 395238 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 395238 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 395238 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 395238 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 395240 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 395240 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/'
   [junit4]   2> 395255 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 395265 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 395269 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 395283 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 395285 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 395293 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 395400 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 395406 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 395407 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 395417 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 395419 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 395421 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 395422 WARN  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 395422 WARN  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 395422 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 395423 WARN  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 395423 WARN  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 395424 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 395424 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 395424 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 395424 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 395424 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@ba75f7
   [junit4]   2> 395425 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/data
   [junit4]   2> 395425 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/data/index/
   [junit4]   2> 395425 WARN  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 395426 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/data/index
   [junit4]   2> 395426 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 395426 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@34f8bffb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c49795e),segFN=segments_1,generation=1}
   [junit4]   2> 395427 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 395430 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 395431 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 395431 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 395431 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 395431 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 395431 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 395432 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 395432 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 395432 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 395434 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 395435 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 395437 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 395437 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 395439 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/data/
   [junit4]   2> 395441 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 395441 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 395443 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 395457 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 395457 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 395458 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 395458 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 395459 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@12b73f88
   [junit4]   2> 395511 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@34f8bffb lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c49795e),segFN=segments_1,generation=1}
   [junit4]   2> 395511 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 395511 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7ee96b62[collection1] main
   [junit4]   2> 395511 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 395512 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 395512 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 395513 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 395513 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 395513 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 395513 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 395514 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 395514 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 395514 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 395514 INFO  (searcherExecutor-989-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7ee96b62[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 395515 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 395515 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 395515 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 395515 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511106101985148928
   [junit4]   2> 395517 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1511106101985148928
   [junit4]   2> 395517 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 395518 INFO  (coreLoadExecutor-988-thread-1-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 395519 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:42527 collection:control_collection shard:shard1
   [junit4]   2> 395522 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 395529 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94444131236184070-core_node1-n_0000000000
   [junit4]   2> 395531 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 395533 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 395533 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 395533 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 395534 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42527/collection1/
   [junit4]   2> 395534 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 395534 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42527/collection1/ has no replicas
   [junit4]   2> 395534 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42527/collection1/ shard1
   [junit4]   2> 395535 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 395540 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:42527",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 395642 INFO  (zkCallback-367-thread-3-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 395642 INFO  (zkCallback-367-thread-2-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 395690 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:42527/collection1/ and leader is http://127.0.0.1:42527/collection1/
   [junit4]   2> 395691 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42527
   [junit4]   2> 395691 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 395691 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 395691 INFO  (coreZkRegister-982-thread-1-processing-n:127.0.0.1:42527_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42527_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 395693 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42527",
   [junit4]   2>   "node_name":"127.0.0.1:42527_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 395693 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42527",
   [junit4]   2>   "node_name":"127.0.0.1:42527_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 395737 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 395738 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 395739 INFO  (zkCallback-369-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c455c5e name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 395739 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 395740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 395740 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 395743 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 395796 INFO  (zkCallback-367-thread-2-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 395796 INFO  (zkCallback-369-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 395796 INFO  (zkCallback-367-thread-3-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 396068 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores/collection1
   [junit4]   2> 396069 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001
   [junit4]   2> 396070 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 396073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1ac9db14{/,null,AVAILABLE}
   [junit4]   2> 396073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.ServerConnector Started ServerConnector@14aabbae{HTTP/1.1}{127.0.0.1:48939}
   [junit4]   2> 396073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.e.j.s.Server Started @399504ms
   [junit4]   2> 396074 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=48939, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores}
   [junit4]   2> 396074 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 396074 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/'
   [junit4]   2> 396095 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 396097 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 396097 INFO  (zkCallback-370-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@332c2496 name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 396098 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 396098 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 396100 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 396100 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/solr.xml
   [junit4]   2> 396105 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores
   [junit4]   2> 396105 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoreContainer New CoreContainer 99389779
   [junit4]   2> 396105 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/]
   [junit4]   2> 396105 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/lib
   [junit4]   2> 396106 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/lib).
   [junit4]   2> 396113 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 396114 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 396114 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 396114 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 396115 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35335/solr
   [junit4]   2> 396115 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 396115 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 396129 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 396129 INFO  (zkCallback-372-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@43cebe31 name:ZooKeeperConnection Watcher:127.0.0.1:35335 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 396130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 396130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 396132 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 396134 INFO  (zkCallback-373-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@83b414e name:ZooKeeperConnection Watcher:127.0.0.1:35335/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 396134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 396140 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 397144 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48939_
   [junit4]   2> 397145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48939_
   [junit4]   2> 397146 INFO  (zkCallback-367-thread-2-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 397146 INFO  (zkCallback-367-thread-3-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 397146 INFO  (zkCallback-369-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 397146 INFO  (zkCallback-373-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 397148 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 397149 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94444131236184074-127.0.0.1:48939_-n_0000000001
   [junit4]   2> 397149 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94444131236184070-127.0.0.1:42527_-n_0000000000 to know if I could be the leader
   [junit4]   2> 397158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 397158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 397159 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores
   [junit4]   2> 397160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 397160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores/collection1/
   [junit4]   2> 397160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 397167 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 397167 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[30C37AFE985C4B24]) [n:127.0.0.1:48939_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 397171 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 397172 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 397176 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48939",
   [junit4]   2>   "node_name":"127.0.0.1:48939_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 397177 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48939",
   [junit4]   2>   "node_name":"127.0.0.1:48939_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 397177 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 397177 INFO  (OverseerStateUpdate-94444131236184070-127.0.0.1:42527_-n_0000000000) [n:127.0.0.1:42527_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 397180 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 397280 INFO  (zkCallback-369-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 397280 INFO  (zkCallback-373-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 397280 INFO  (zkCallback-367-thread-3-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 397280 INFO  (zkCallback-367-thread-2-processing-n:127.0.0.1:42527_) [n:127.0.0.1:42527_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 398181 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 398181 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 398182 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 398182 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
   [junit4]   2> 398182 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 398182 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_30C37AFE985C4B24-001/shard-1-001/cores/collection1/'
   [junit4]   2> 398199 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 398204 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 398207 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 398217 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 398218 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 398222 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 398319 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 398325 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 398326 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 398336 INFO  (coreLoadExecutor-999-thread-1-processing-n:127.0.0.1:48939_) [n:127.0.0.1:48939_ c:collection1   x:collecti

[...truncated too long message...]

ultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4635211 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[30C37AFE985C4B24]-worker) [n:127.0.0.1:55220_g_ju c:addReplicaColl s:shard1 r:core_node2 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 01, 2015 7:35:19 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene53, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=es_VE, timezone=Asia/Dacca
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=193793272,total=534249472
   [junit4]   2> NOTE: All tests run in this JVM: [TestTrackingShardHandlerFactory, TestFoldingMultitermQuery, BlockDirectoryTest, DeleteShardTest, TestSimpleTrackingShardHandler, SpellingQueryConverterTest, CollectionsAPIAsyncDistributedZkTest, TestSortingResponseWriter, HighlighterMaxOffsetTest, TestMissingGroups, CachingDirectoryFactoryTest, DisMaxRequestHandlerTest, TestSortByMinMaxFunction, CacheHeaderTest, TestConfig, StandardRequestHandlerTest, TestArbitraryIndexDir, RemoteQueryErrorTest, CoreAdminCreateDiscoverTest, CurrencyFieldOpenExchangeTest, TestSerializedLuceneMatchVersion, CursorPagingTest, BigEndianAscendingWordSerializerTest, UUIDUpdateProcessorFallbackTest, TestPKIAuthenticationPlugin, PingRequestHandlerTest, TestManagedSchemaFieldResource, TestInitQParser, SolrCoreTest, PolyFieldTest, SolrRequestParserTest, TestSolrConfigHandlerConcurrent, TestDynamicFieldResource, TestRawResponseWriter, RollingRestartTest, TestExactStatsCache, TestJsonRequest, TestComponentsName, HdfsBasicDistributedZk2Test, IndexSchemaRuntimeFieldTest, TestDocumentBuilder, TestRandomDVFaceting, ConnectionManagerTest, TestDownShardTolerantSearch, FileBasedSpellCheckerTest, TestDistribIDF, TestConfigSetImmutable, BaseCdcrDistributedZkTest, ExternalFileFieldSortTest, TestIBSimilarityFactory, DateFieldTest, TestAtomicUpdateErrorCases, TestBinaryField, CdcrReplicationHandlerTest, TestConfigSetsAPIZkFailure, TestStressLucene, ActionThrottleTest, HttpPartitionTest, CoreMergeIndexesAdminHandlerTest, TestRandomFaceting, RequestLoggingTest, ReplicationFactorTest, TestLazyCores, SOLR749Test, TestBlobHandler, PathHierarchyTokenizerFactoryTest, TestSolrJ, TestFaceting, TestCollationFieldDocValues, ReturnFieldsTest, TestLuceneMatchVersion, TestFieldCollectionResource, TestAnalyzedSuggestions, DistributedQueryElevationComponentTest, PrimUtilsTest, JSONWriterTest, DistributedFacetPivotLargeTest, TestDocSet, TestSchemaResource, EnumFieldTest, DistributedFacetPivotSmallTest, OpenExchangeRatesOrgProviderTest, TestReplicaProperties, TestHdfsUpdateLog, SignatureUpdateProcessorFactoryTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, BasicDistributedZkTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, TestDistributedGrouping, TestRecovery, TestHashPartitioner, DistributedSpellCheckComponentTest, TestRealTimeGet, TestJoin, TestReload, DistributedTermsComponentTest, SpellCheckComponentTest, TestGroupingSearch, BasicFunctionalityTest, HighlighterTest, ShowFileRequestHandlerTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, DocValuesTest, SuggesterTest, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, TestUpdate, QueryEqualityTest, SortByFunctionTest, TestRemoteStreaming, XsltUpdateRequestHandlerTest, TestWriterPerf, RequestHandlersTest, TestValueSourceCache, TermVectorComponentTest, RequiredFieldsTest, LoggingHandlerTest, SolrPluginUtilsTest, TestJmxIntegration, QueryParsingTest, JsonLoaderTest, TestBinaryResponseWriter, AlternateDirectoryTest, ResponseLogComponentTest, TestMergePolicyConfig, MultiTermTest, OutputWriterTest, TestSolrCoreProperties, TestPhraseSuggestions, SynonymTokenizerTest, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, TimeZoneUtilsTest, ScriptEngineTest, PreAnalyzedFieldTest, RAMDirectoryFactoryTest, TestLRUCache, TestUtils, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, DistributedIntervalFacetingTest, AsyncCallRequestStatusResponseTest, AsyncMigrateRouteKeyTest, CollectionReloadTest, CustomCollectionTest, DistribJoinFromCollectionTest, LeaderInitiatedRecoveryOnCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestCloudInspectUtil, TestCloudPivotFacet, TestCollectionAPI, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestLeaderElectionZkExpiry, TestMiniSolrCloudCluster, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [543/543] on J0 in 963.64s, 1 test, 1 error <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 543 suites, 2145 tests, 2 errors, 30 ignored (18 assumptions)

Total time: 194 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 781 - Still Failing

Posted by Robert Muir <rc...@gmail.com>.
I committed a fix. LUCENE-6539 simplified this test but then we lost
the changes from LUCENE-6206 which will avoid annoying test failures
for this jdk bug. I banned it with forbidden apis.

On Mon, Aug 31, 2015 at 5:29 AM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/781/
>
> 1 tests failed.
> REGRESSION:  org.apache.lucene.collation.TestCollationDocValuesField.testRanges
>
> Error Message:
> expected:<false> but was:<true>
>
> Stack Trace:
> java.lang.AssertionError: expected:<false> but was:<true>
>         at __randomizedtesting.SeedInfo.seed([F96E1F95981C9AB3:24D76E5AF75ECC55]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.failNotEquals(Assert.java:647)
>         at org.junit.Assert.assertEquals(Assert.java:128)
>         at org.junit.Assert.assertEquals(Assert.java:147)
>         at org.apache.lucene.collation.TestCollationDocValuesField.doTestRanges(TestCollationDocValuesField.java:126)
>         at org.apache.lucene.collation.TestCollationDocValuesField.testRanges(TestCollationDocValuesField.java:110)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:497)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 2644 lines...]
>    [junit4] Suite: org.apache.lucene.collation.TestCollationDocValuesField
>    [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCollationDocValuesField -Dtests.method=testRanges -Dtests.seed=F96E1F95981C9AB3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=et_EE -Dtests.timezone=Europe/Istanbul -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
>    [junit4] FAILURE 5.90s J1 | TestCollationDocValuesField.testRanges <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: expected:<false> but was:<true>
>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([F96E1F95981C9AB3:24D76E5AF75ECC55]:0)
>    [junit4]    >        at org.apache.lucene.collation.TestCollationDocValuesField.doTestRanges(TestCollationDocValuesField.java:126)
>    [junit4]    >        at org.apache.lucene.collation.TestCollationDocValuesField.testRanges(TestCollationDocValuesField.java:110)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/common/test/J1/temp/lucene.collation.TestCollationDocValuesField_F96E1F95981C9AB3-001
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {field=PostingsFormat(name=LuceneFixedGap)}, docValues:{collated=DocValuesFormat(name=Lucene50)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=et_EE, timezone=Europe/Istanbul
>    [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=308404992,total=343932928
>    [junit4]   2> NOTE: All tests run in this JVM: [TestCollationDocValuesField]
>    [junit4] Completed [15/276] on J1 in 7.11s, 2 tests, 1 failure <<< FAILURES!
>
> [...truncated 791 lines...]
> BUILD FAILED
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:471: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:2162: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/analysis/build.xml:106: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/analysis/build.xml:38: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/module-build.xml:58: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
> /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 276 suites, 1413 tests, 1 failure, 1 ignored
>
> Total time: 72 minutes 36 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> No prior successful build to compare, so performing full copy of artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org