You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/09/11 00:14:11 UTC

[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 791 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/791/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=12534, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=12534, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38890/hlt/t, http://127.0.0.1:48420/hlt/t, http://127.0.0.1:48234/hlt/t, http://127.0.0.1:43463/hlt/t, http://127.0.0.1:35967/hlt/t]
	at __randomizedtesting.SeedInfo.seed([D304BAF25EEA1E21]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:38890/hlt/t, http://127.0.0.1:48420/hlt/t, http://127.0.0.1:48234/hlt/t, http://127.0.0.1:43463/hlt/t, http://127.0.0.1:35967/hlt/t]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:48234/hlt/t: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 5 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=32471, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=32471, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45492/co/zf: Could not find collection : awholynewstresscollection_collection4_0
	at __randomizedtesting.SeedInfo.seed([D304BAF25EEA1E21]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10342 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/init-core-data-001
   [junit4]   2> 1232711 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D304BAF25EEA1E21]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1232712 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D304BAF25EEA1E21]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /hlt/t
   [junit4]   2> 1232714 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1232714 INFO  (Thread-9127) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1232714 INFO  (Thread-9127) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1232814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkTestServer start zk server on port:52781
   [junit4]   2> 1232814 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232815 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232818 INFO  (zkCallback-598-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@313967f3 name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232818 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232819 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232819 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1232822 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232822 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232830 INFO  (zkCallback-599-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@85aeb3a name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232831 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1232832 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1232834 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1232835 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1232836 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1232837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1232839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1232839 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1232841 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232841 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232842 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1232843 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1232844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1232844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1232846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1232846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1232847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1232847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1232849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1232849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1232850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232851 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1232852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1232854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1232854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1232856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232858 INFO  (zkCallback-600-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@345be015 name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1232860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1232860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1232861 INFO  (zkCallback-601-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d2f4d61 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1232861 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1232861 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1232862 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1232862 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1232864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1232864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1232866 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1232866 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1232868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1232869 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1232870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1232871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1232872 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1232873 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1232873 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1232875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1232875 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1232877 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232877 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1232879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1232879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1232880 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1232881 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1232882 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1232882 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1233186 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1
   [junit4]   2> 1233187 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1233189 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b212dc7{/hlt/t,null,AVAILABLE}
   [junit4]   2> 1233194 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6fd264c8{HTTP/1.1}{127.0.0.1:48234}
   [junit4]   2> 1233194 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server Started @1236500ms
   [junit4]   2> 1233195 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/tempDir-001/control/data, hostContext=/hlt/t, hostPort=48234, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores}
   [junit4]   2> 1233195 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1233195 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/'
   [junit4]   2> 1233211 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1233212 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233213 INFO  (zkCallback-602-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6635284e name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233214 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1233214 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1233215 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1233215 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/solr.xml
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer New CoreContainer 1376837303
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/]
   [junit4]   2> 1233220 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/lib
   [junit4]   2> 1233221 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/lib).
   [junit4]   2> 1233228 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1233229 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52781/solr
   [junit4]   2> 1233230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1233230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1233230 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233231 INFO  (zkCallback-604-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7906dfab name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233232 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1233233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1233234 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233235 INFO  (zkCallback-605-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b74d49e name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233235 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1233236 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1233238 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1233240 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1233242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1233244 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1233246 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1233248 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1233249 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1233250 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1233251 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48234_hlt%2Ft
   [junit4]   2> 1233251 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48234_hlt%2Ft
   [junit4]   2> 1233253 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1233254 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1233255 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1233256 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000
   [junit4]   2> 1233256 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48234_hlt%2Ft
   [junit4]   2> 1233257 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1233258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer Overseer (id=94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) starting
   [junit4]   2> 1233260 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1233266 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1233266 INFO  (OverseerCollectionConfigSetProcessor-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1233267 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1233267 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1233281 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1233282 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1233282 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores
   [junit4]   2> 1233283 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1233283 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/
   [junit4]   2> 1233284 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1233285 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1233285 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1233285 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1233285 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1233287 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1233287 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1233287 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1233288 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1233288 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1233290 INFO  (zkCallback-605-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234288 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1234288 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1234289 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1234289 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1234290 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1234290 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/'
   [junit4]   2> 1234305 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1234310 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1234323 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1234330 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1234331 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1234336 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1234416 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1234422 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1234423 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1234432 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1234435 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1234437 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1234438 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1234438 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1234438 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1234439 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1234439 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1234440 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1234440 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1234440 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1234441 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1234441 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f950df
   [junit4]   2> 1234441 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data
   [junit4]   2> 1234442 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1234442 WARN  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1234442 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/index
   [junit4]   2> 1234442 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1234443 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@576cef24 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2ab92475),segFN=segments_1,generation=1}
   [junit4]   2> 1234443 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1234444 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/
   [junit4]   2> 1234444 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1234448 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1234449 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1234451 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234452 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234453 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234454 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1234457 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1234457 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1234458 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1234458 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1234466 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1234466 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=598478639, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@576cef24 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2ab92475),segFN=segments_1,generation=1}
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1234467 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@69b4d74c[collection1] main
   [junit4]   2> 1234468 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1234468 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1234468 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1234469 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1234469 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1234469 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1234470 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1234471 INFO  (searcherExecutor-1617-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@69b4d74c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1234471 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1511961473387069440
   [junit4]   2> 1234474 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1511961473387069440
   [junit4]   2> 1234474 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1234474 INFO  (coreLoadExecutor-1616-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1234475 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:48234/hlt/t collection:control_collection shard:shard1
   [junit4]   2> 1234476 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1234480 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94497591971676166-core_node1-n_0000000000
   [junit4]   2> 1234481 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48234/hlt/t/collection1/
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1234483 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48234/hlt/t/collection1/ has no replicas
   [junit4]   2> 1234483 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48234/hlt/t/collection1/ shard1
   [junit4]   2> 1234484 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1234486 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1234489 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1234591 INFO  (zkCallback-605-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234639 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:48234/hlt/t/collection1/ and leader is http://127.0.0.1:48234/hlt/t/collection1/
   [junit4]   2> 1234639 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48234/hlt/t
   [junit4]   2> 1234640 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1234640 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1234640 INFO  (coreZkRegister-1610-thread-1-processing-n:127.0.0.1:48234_hlt%2Ft x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48234_hlt%2Ft c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1234642 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1234643 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:48234/hlt/t",
   [junit4]   2>   "node_name":"127.0.0.1:48234_hlt%2Ft",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1234746 INFO  (zkCallback-605-thread-2-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234787 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1234788 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1234789 INFO  (zkCallback-607-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74bd4809 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1234789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1234790 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1234790 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1234793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1234794 INFO  (zkCallback-608-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d2924c1 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1234795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1234795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1234797 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x14fb90f299a0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1234797 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 1234798 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1234900 INFO  (OverseerStateUpdate-94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1235107 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores/collection1
   [junit4]   2> 1235108 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001
   [junit4]   2> 1235108 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1235110 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56d30f0e{/hlt/t,null,AVAILABLE}
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6778ed9b{HTTP/1.1}{127.0.0.1:38890}
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.e.j.s.Server Started @1238417ms
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/hlt/t, hostPort=38890, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores}
   [junit4]   2> 1235111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1235112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/'
   [junit4]   2> 1235127 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1235127 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235129 INFO  (zkCallback-609-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bea2446 name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235129 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1235129 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1235130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1235130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/solr.xml
   [junit4]   2> 1235135 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores
   [junit4]   2> 1235135 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer New CoreContainer 2037587153
   [junit4]   2> 1235136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/]
   [junit4]   2> 1235136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/lib
   [junit4]   2> 1235136 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/lib).
   [junit4]   2> 1235143 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1235144 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52781/solr
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1235145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1235146 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235150 INFO  (zkCallback-611-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@62ab0eef name:ZooKeeperConnection Watcher:127.0.0.1:52781 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1235151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1235154 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235155 INFO  (zkCallback-612-thread-1-processing-n:127.0.0.1:38890_hlt%2Ft) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@794bbf7e name:ZooKeeperConnection Watcher:127.0.0.1:52781/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235155 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1235164 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1236170 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38890_hlt%2Ft
   [junit4]   2> 1236171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38890_hlt%2Ft
   [junit4]   2> 1236173 INFO  (zkCallback-607-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236173 INFO  (zkCallback-605-thread-2-processing-n:127.0.0.1:48234_hlt%2Ft) [n:127.0.0.1:48234_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236173 INFO  (zkCallback-612-thread-1-processing-n:127.0.0.1:38890_hlt%2Ft) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236175 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1236176 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94497591971676171-127.0.0.1:38890_hlt%2Ft-n_0000000001
   [junit4]   2> 1236177 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94497591971676166-127.0.0.1:48234_hlt%2Ft-n_0000000000 to know if I could be the leader
   [junit4]   2> 1236185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1236185 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1236186 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D304BAF25EEA1E21-001/shard-1-001/cores
   [junit4]   2> 1236187 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D304BAF25EEA1E21]) [n:127.0.0.1:38890_hlt%2Ft    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-t

[...truncated too long message...]

[junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 5490216 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[D304BAF25EEA1E21]-worker) [n:127.0.0.1:45492_co%2Fzf c:addReplicaColl s:shard1 r:core_node1 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 10, 2015 6:11:21 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=FSTOrd50, _version_=Lucene50(blocksize=128), multiDefault=FST50, a_t=Lucene50(blocksize=128), intDefault=Lucene50(blocksize=128), a_i1=Lucene50(blocksize=128), id=FSTOrd50, range_facet_i_dv=Lucene50(blocksize=128), text=PostingsFormat(name=Asserting), range_facet_l=Lucene50(blocksize=128), timestamp=Lucene50(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Lucene50), timestamp=DocValuesFormat(name=Lucene50)}, sim=DefaultSimilarity, locale=th_TH_TH_#u-nu-thai, timezone=Africa/Harare
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=186056512,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [SolrInfoMBeanTest, ExplicitHLLTest, BJQParserTest, CSVRequestHandlerTest, TestMaxScoreQueryParser, TestStressUserVersions, VMParamsZkACLAndCredentialsProvidersTest, LeaderFailoverAfterPartitionTest, BitVectorTest, TestSolrQueryParserResource, TestNamedUpdateProcessors, DistanceFunctionTest, OpenCloseCoreStressTest, SolrPluginUtilsTest, TestSQLHandler, SpatialFilterTest, DistanceUnitsTest, TestPartialUpdateDeduplication, TestCloudManagedSchema, ZkStateReaderTest, TestOverriddenPrefixQueryForCustomFieldType, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DocExpirationUpdateProcessorFactoryTest, FastVectorHighlighterTest, TestBlendedInfixSuggestions, TestCustomDocTransformer, HdfsRecoveryZkTest, TestCustomSort, TestFieldTypeResource, TestFastOutputStream, HdfsLockFactoryTest, SolrCmdDistributorTest, DocValuesTest, HLLSerializationTest, DistributedQueueTest, TestAuthenticationFramework, ChaosMonkeyNothingIsSafeTest, TestSchemaManager, TestJettySolrRunner, TestCoreContainer, TestConfigSets, TestFileDictionaryLookup, SSLMigrationTest, TestRestoreCore, TestManagedSchemaFieldTypeResource, TestTrie, TestCrossCoreJoin, URLClassifyProcessorTest, TestDistributedGrouping, TermsComponentTest, TestUtils, TestUniqueKeyFieldResource, CollectionsAPIDistributedZkTest, TestSuggestSpellingConverter, NumericFieldsTest, MultiTermTest, TestManagedSchema, TestWordDelimiterFilterFactory, TestBM25SimilarityFactory, ClusterStateUpdateTest, TestOrdValues, TestReloadDeadlock, TestTolerantSearch, LoggingHandlerTest, SolrCloudExampleTest, PreAnalyzedUpdateProcessorTest, TestCloudPivotFacet, TestReqParamsAPI, UpdateRequestProcessorFactoryTest, TestDFRSimilarityFactory, TestDistribDocBasedVersion, TestCopyFieldCollectionResource, SolrIndexConfigTest, MinimalSchemaTest, SolrIndexSplitterTest, TriLevelCompositeIdRoutingTest, TestSolrDeletionPolicy2, BasicFunctionalityTest, TestMacros, SliceStateTest, SimpleMLTQParserTest, HighlighterTest, DocumentBuilderTest, SharedFSAutoReplicaFailoverTest, DistributedFacetPivotWhiteBoxTest, TestBinaryResponseWriter, TestDefaultSearchFieldResource, TestRandomFaceting, TermVectorComponentDistributedTest, TestJoin, TestStressVersions, TestRangeQuery, SolrCoreTest, QueryElevationComponentTest, TestFunctionQuery, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, CurrencyFieldOpenExchangeTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SolrRequestParserTest, SuggesterTSTTest, TestCSVLoader, SchemaVersionSpecificBehaviorTest, TestUpdate, StatelessScriptUpdateProcessorFactoryTest, IndexBasedSpellCheckerTest, TestQueryUtils, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, RegexBoostProcessorTest, TestCollationField, JSONWriterTest, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, TestLFUCache, CdcrReplicationDistributedZkTest, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, TestShortCircuitedRequests, HdfsBasicDistributedZk2Test, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [545/545] on J1 in 2158.23s, 1 test, 1 error <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 545 suites, 2143 tests, 2 errors, 29 ignored (17 assumptions)

Total time: 216 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 792 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/792/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=2704, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=2704, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:47130, https://127.0.0.1:60146, https://127.0.0.1:36655, https://127.0.0.1:41275, https://127.0.0.1:57179]
	at __randomizedtesting.SeedInfo.seed([C906CE0EF902FA4F]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:47130, https://127.0.0.1:60146, https://127.0.0.1:36655, https://127.0.0.1:41275, https://127.0.0.1:57179]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:60146: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 5 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=73357, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=73357, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44465/vt_mcn/re: Could not find collection : awholynewstresscollection_collection5_1
	at __randomizedtesting.SeedInfo.seed([C906CE0EF902FA4F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1099)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 9963 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/init-core-data-001
   [junit4]   2> 415318 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[C906CE0EF902FA4F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 415318 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[C906CE0EF902FA4F]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 415320 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 415330 INFO  (Thread-1017) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 415330 INFO  (Thread-1017) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 415421 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkTestServer start zk server on port:41643
   [junit4]   2> 415421 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415422 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415429 INFO  (zkCallback-250-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@72b433b6 name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415429 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415429 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415430 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 415434 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415450 INFO  (zkCallback-251-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5356aa17 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 415454 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 415457 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 415458 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 415459 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 415460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 415463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 415463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 415465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415467 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 415468 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 415470 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 415470 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 415472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 415472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 415473 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 415474 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 415475 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 415475 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 415477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415478 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 415479 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 415481 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 415481 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 415484 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415484 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415486 INFO  (zkCallback-252-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d9f529d name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415486 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415487 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415490 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415491 INFO  (zkCallback-253-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c8d93fe name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 415494 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 415498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 415502 INFO  (zkCallback-254-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ff7a1e name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 415502 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 415502 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 415503 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 415503 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 415508 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 415508 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 415511 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 415511 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 415518 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415519 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 415521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 415521 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 415535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 415535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 415537 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 415537 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 415539 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 415539 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 415540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 415544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 415544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 415545 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 415545 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 415547 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 415547 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 416021 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1
   [junit4]   2> 416023 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 416027 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@470eb728{/,null,AVAILABLE}
   [junit4]   2> 416048 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@25b9bd6{SSL-http/1.1}{127.0.0.1:36655}
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server Started @419249ms
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/tempDir-001/control/data, hostContext=/, hostPort=36655, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores}
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 416049 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/'
   [junit4]   2> 416065 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 416066 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 416070 INFO  (zkCallback-255-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a2d1bf5 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 416070 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 416070 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 416073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 416073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/solr.xml
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer New CoreContainer 1967112450
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/]
   [junit4]   2> 416083 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/lib
   [junit4]   2> 416083 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/lib).
   [junit4]   2> 416092 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 416099 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 416101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 416101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 416101 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41643/solr
   [junit4]   2> 416102 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 416102 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 416110 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 416116 INFO  (zkCallback-257-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d1a90ed name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 416117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 416118 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 416122 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 416130 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76233f4f name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 416130 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 416132 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 416134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 416140 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 416143 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 416154 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 416157 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 416158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 416159 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 416160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 416166 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36655_
   [junit4]   2> 416166 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:36655_
   [junit4]   2> 416168 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 416169 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 416170 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 416171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94508122102693895-127.0.0.1:36655_-n_0000000000
   [junit4]   2> 416171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36655_
   [junit4]   2> 416171 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 416172 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer Overseer (id=94508122102693895-127.0.0.1:36655_-n_0000000000) starting
   [junit4]   2> 416174 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 416193 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 416203 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 416203 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 416207 INFO  (OverseerCollectionConfigSetProcessor-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 416219 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 416233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 416233 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 416242 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores
   [junit4]   2> 416245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 416245 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/
   [junit4]   2> 416246 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 416258 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 416258 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 416259 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 416259 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:36655_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 416264 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 416264 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 416265 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 416266 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 416267 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 416268 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 416269 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417265 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 417265 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 417266 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 417266 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 417267 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 417267 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/'
   [junit4]   2> 417284 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 417297 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 417301 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 417310 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 417311 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 417316 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 417424 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 417447 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 417448 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 417463 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 417470 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 417473 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 417474 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 417474 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 417474 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 417475 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 417475 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 417477 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 417477 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 417482 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 417486 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 417486 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@716ca58f
   [junit4]   2> 417487 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data
   [junit4]   2> 417487 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/index/
   [junit4]   2> 417487 WARN  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 417487 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/index
   [junit4]   2> 417488 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1c8952c
   [junit4]   2> 417498 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2b54f906 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6fc102),segFN=segments_1,generation=1}
   [junit4]   2> 417498 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 417510 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/
   [junit4]   2> 417510 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 417512 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 417513 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 417514 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 417516 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 417516 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 417516 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 417519 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417520 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417521 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417522 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 417533 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 417533 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 417551 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 417551 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 417552 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 417552 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 417552 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=90.6552734375, floorSegmentMB=1.8486328125, forceMergeDeletesPctAllowed=15.77473054312975, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 417553 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2b54f906 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a6fc102),segFN=segments_1,generation=1}
   [junit4]   2> 417553 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 417553 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@164cd192[collection1] main
   [junit4]   2> 417554 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 417556 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 417556 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 417556 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 417557 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 417558 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1512129955968843776
   [junit4]   2> 417560 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1512129955968843776
   [junit4]   2> 417563 INFO  (searcherExecutor-1085-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@164cd192[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 417564 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 417565 INFO  (coreLoadExecutor-1084-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 417577 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:36655 collection:control_collection shard:shard1
   [junit4]   2> 417578 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 417583 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94508122102693895-core_node1-n_0000000000
   [junit4]   2> 417584 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36655/collection1/
   [junit4]   2> 417586 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 417587 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:36655/collection1/ has no replicas
   [junit4]   2> 417587 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:36655/collection1/ shard1
   [junit4]   2> 417587 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 417590 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 417592 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 417596 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 417699 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417699 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417748 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:36655/collection1/ and leader is https://127.0.0.1:36655/collection1/
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:36655
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 417749 INFO  (coreZkRegister-1078-thread-1-processing-n:127.0.0.1:36655_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:36655_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 417751 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 417752 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:36655",
   [junit4]   2>   "node_name":"127.0.0.1:36655_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 417770 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 417784 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 417788 INFO  (zkCallback-260-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54ae017b name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 417789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 417789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 417789 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 417792 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 417793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 417793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 417793 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 417795 INFO  (zkCallback-261-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5162c74f name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 417795 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 417796 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 417810 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 417810 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 417814 INFO  (zkCallback-260-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417822 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417822 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 417930 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 418201 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1
   [junit4]   2> 418202 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001
   [junit4]   2> 418203 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 418207 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@18eb941b{/,null,AVAILABLE}
   [junit4]   2> 418216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1c4e353f{SSL-http/1.1}{127.0.0.1:47130}
   [junit4]   2> 418216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.e.j.s.Server Started @421417ms
   [junit4]   2> 418216 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=47130, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores}
   [junit4]   2> 418217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 418217 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/'
   [junit4]   2> 418239 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 418239 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 418247 INFO  (zkCallback-262-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a39c391 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 418247 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 418247 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 418252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 418252 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/solr.xml
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer New CoreContainer 332013229
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/]
   [junit4]   2> 418258 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/lib
   [junit4]   2> 418259 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/lib).
   [junit4]   2> 418270 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 418273 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41643/solr
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 418275 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 418292 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 418304 INFO  (zkCallback-264-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46bd5901 name:ZooKeeperConnection Watcher:127.0.0.1:41643 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 418305 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 418306 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 418331 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 418350 INFO  (zkCallback-265-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5411a7c8 name:ZooKeeperConnection Watcher:127.0.0.1:41643/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 418350 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 418356 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 419361 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47130_
   [junit4]   2> 419361 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47130_
   [junit4]   2> 419362 INFO  (zkCallback-265-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419363 INFO  (zkCallback-258-thread-2-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419363 INFO  (zkCallback-258-thread-1-processing-n:127.0.0.1:36655_) [n:127.0.0.1:36655_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419364 INFO  (zkCallback-260-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 419364 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 419365 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94508122102693900-127.0.0.1:47130_-n_0000000001
   [junit4]   2> 419365 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94508122102693895-127.0.0.1:36655_-n_0000000000 to know if I could be the leader
   [junit4]   2> 419383 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 419383 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 419384 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores
   [junit4]   2> 419385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 419385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_C906CE0EF902FA4F-001/shard-1-001/cores/collection1/
   [junit4]   2> 419385 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 419388 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 419388 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 419390 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 419390 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 419390 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:47130",
   [junit4]   2>   "node_name":"127.0.0.1:47130_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 419391 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for collection1 ver 0 
   [junit4]   2> 419391 INFO  (coreLoadExecutor-1095-thread-1-processing-n:127.0.0.1:47130_) [n:127.0.0.1:47130_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 419391 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:47130",
   [junit4]   2>   "node_name":"127.0.0.1:47130_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 419391 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 419391 INFO  (OverseerStateUpdate-94508122102693895-127.0.0.1:36655_-n_0000000000) [n:127.0.0.1:36655_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 419398 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.1:47130_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 419398 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[C906CE0EF902FA4F]) [n:127.0.0.

[...truncated too long message...]

62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4082009 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[C906CE0EF902FA4F]-worker) [n:127.0.0.1:44465_vt_mcn%2Fre c:addReplicaColl s:shard1 r:core_node7 x:propertyDotName] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Sep 12, 2015 2:39:27 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=FST50, _version_=Lucene50(blocksize=128), multiDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), intDefault=Lucene50(blocksize=128), a_i1=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=FST50, range_facet_i_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=PostingsFormat(name=Direct), range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Lucene50), timestamp=DocValuesFormat(name=Lucene50)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_KW, timezone=Canada/Atlantic
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=133740264,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [DateFieldTest, SmileWriterTest, SparseHLLTest, ResourceLoaderTest, AlternateDirectoryTest, RankQueryTest, RollingRestartTest, CdcrReplicationDistributedZkTest, DeleteShardTest, EnumFieldTest, TestIntervalFaceting, ConnectionManagerTest, JavabinLoaderTest, TestSolrQueryParserDefaultOperatorResource, TestCloudSchemaless, HighlighterMaxOffsetTest, TestSchemaSimilarityResource, BasicZkTest, RequiredFieldsTest, TestSchemaResource, SpatialHeatmapFacetsTest, TestDistributedSearch, ChangedSchemaMergeTest, DistributedFacetPivotLargeTest, DistributedIntervalFacetingTest, TestLMDirichletSimilarityFactory, InfoHandlerTest, JSONWriterTest, TestLuceneMatchVersion, TestBlobHandler, TestDocumentBuilder, DistribJoinFromCollectionTest, TestSolrJ, TestExceedMaxTermLength, SolrRequestParserTest, DocumentAnalysisRequestHandlerTest, TestJoin, AnalysisAfterCoreReloadTest, CdcrReplicationHandlerTest, OpenExchangeRatesOrgProviderTest, TestFaceting, TestChildDocTransformer, ReplicationFactorTest, TestRealTimeGet, FileBasedSpellCheckerTest, ActionThrottleTest, TestRandomDVFaceting, SaslZkACLProviderTest, CollectionStateFormat2Test, TestPseudoReturnFields, TestAnalyzedSuggestions, TestNoOpRegenerator, UUIDUpdateProcessorFallbackTest, PeerSyncTest, BlockDirectoryTest, DistributedSuggestComponentTest, TestStandardQParsers, TestDynamicFieldResource, RequestLoggingTest, TestSimpleQParserPlugin, CursorPagingTest, TestFoldingMultitermQuery, TestConfigSetsAPIZkFailure, OverseerRolesTest, EchoParamsTest, TestInitQParser, TestAtomicUpdateErrorCases, TestPKIAuthenticationPlugin, OutputWriterTest, TestLazyCores, CollectionTooManyReplicasTest, DateMathParserTest, CurrencyFieldOpenExchangeTest, DateRangeFieldTest, TestSolrConfigHandlerConcurrent, SOLR749Test, RemoteQueryErrorTest, VersionInfoTest, SolrTestCaseJ4Test, TimeZoneUtilsTest, TestRandomMergePolicy, LeaderInitiatedRecoveryOnCommitTest, TestReloadAndDeleteDocs, OverseerStatusTest, XsltUpdateRequestHandlerTest, DistributedVersionInfoTest, TestSchemaNameResource, QueryElevationComponentTest, ExitableDirectoryReaderTest, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestZkChroot, ShardRoutingCustomTest, AutoCommitTest, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestStressReorder, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, BadIndexSchemaTest, TestFunctionQuery, TestBadConfig, TestIndexSearcher, HighlighterTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, TestStressLucene, PolyFieldTest, WordBreakSolrSpellCheckerTest, QueryEqualityTest, TestRemoteStreaming, CacheHeaderTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, TestWriterPerf, TestOmitPositions, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, FastVectorHighlighterTest, LoggingHandlerTest, IndexSchemaTest, TestCollationField, MBeansHandlerTest, JsonLoaderTest, PingRequestHandlerTest, MultiTermTest, TestDocSet, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, ExternalFileFieldSortTest, DirectSolrConnectionTest, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, TestPerFieldSimilarity, TestBM25SimilarityFactory, ScriptEngineTest, PreAnalyzedFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestUtils, SliceStateTest, FileUtilsTest, DistributedMLTComponentTest, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, AssignTest, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CollectionReloadTest, DistributedQueueTest, HttpPartitionTest, TestConfigSetsAPI, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestReplicaProperties, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [540/545] on J0 in 835.99s, 1 test, 1 error <<< FAILURES!

[...truncated 27 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 545 suites, 2144 tests, 2 errors, 29 ignored (17 assumptions)

Total time: 184 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure