You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/06/13 12:26:50 UTC
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 710 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/710/
4 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=10086, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10086, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:37241, http://127.0.0.1:60559, http://127.0.0.1:58483, http://127.0.0.1:56264, http://127.0.0.1:48920]
at __randomizedtesting.SeedInfo.seed([76A61FB8AE401695]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:905)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:37241, http://127.0.0.1:60559, http://127.0.0.1:58483, http://127.0.0.1:56264, http://127.0.0.1:48920]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:48920: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
... 5 more
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=39775, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=39775, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:50805: Could not find collection : awholynewstresscollection_collection1_2
at __randomizedtesting.SeedInfo.seed([76A61FB8AE401695]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
FAILED: org.apache.solr.core.HdfsDirectoryFactoryTest.testLocalityReporter
Error Message:
expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([76A61FB8AE401695:38BB9040FF706778]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.core.HdfsDirectoryFactoryTest.testLocalityReporter(HdfsDirectoryFactoryTest.java:217)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Sat Jun 13 19:54:14 DDUT 2015
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Sat Jun 13 19:54:14 DDUT 2015
at __randomizedtesting.SeedInfo.seed([76A61FB8AE401695:AD0D1F7EAB687F26]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1417)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:769)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10382 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/init-core-data-001
[junit4] 2> 1353561 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[76A61FB8AE401695]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1353561 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[76A61FB8AE401695]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1353564 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1353564 INFO (Thread-6746) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1353564 INFO (Thread-6746) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1353664 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ZkTestServer start zk server on port:35820
[junit4] 2> 1353665 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1353665 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1353668 INFO (zkCallback-592-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@682013a6 name:ZooKeeperConnection Watcher:127.0.0.1:35820 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1353668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1353668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1353668 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1353671 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1353671 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1353674 INFO (zkCallback-593-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5181d8a1 name:ZooKeeperConnection Watcher:127.0.0.1:35820/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1353674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1353674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1353675 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 1353676 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 1353678 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 1353679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 1353680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1353680 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1353682 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1353682 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 1353684 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1353684 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1353686 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1353686 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1353687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1353687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 1353689 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1353689 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 1353690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1353690 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1353692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1353692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1353693 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1353693 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1353695 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1353695 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1353696 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1353696 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1353698 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1353699 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1353700 INFO (zkCallback-594-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2cf0ef32 name:ZooKeeperConnection Watcher:127.0.0.1:35820 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1353700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1353700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1353700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 1353701 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1353702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1353703 INFO (zkCallback-595-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d02bd44 name:ZooKeeperConnection Watcher:127.0.0.1:35820/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1353703 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1353703 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1353703 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 1353704 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 1353705 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 1353705 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 1353707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 1353707 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 1353709 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1353709 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1353710 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 1353710 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 1353712 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 1353712 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 1353713 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 1353714 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 1353715 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 1353715 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 1353716 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1353717 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1353718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 1353718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 1353719 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 1353720 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 1353721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 1353721 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 1353990 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1
[junit4] 2> 1353992 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 1353993 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a37f451{/,null,AVAILABLE}
[junit4] 2> 1353996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.ServerConnector Started ServerConnector@558bdafe{HTTP/1.1}{127.0.0.1:37241}
[junit4] 2> 1353996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.Server Started @1357184ms
[junit4] 2> 1353996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/tempDir-001/control/data, hostContext=/, hostPort=37241, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores}
[junit4] 2> 1353997 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 1353997 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/'
[junit4] 2> 1354010 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/solr.xml
[junit4] 2> 1354015 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores
[junit4] 2> 1354015 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoreContainer New CoreContainer 1561390122
[junit4] 2> 1354015 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/]
[junit4] 2> 1354015 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/lib
[junit4] 2> 1354015 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/lib).
[junit4] 2> 1354022 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1354023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1354023 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1354024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1354024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35820/solr
[junit4] 2> 1354024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1354024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1354024 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1354026 INFO (zkCallback-597-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@160f4c64 name:ZooKeeperConnection Watcher:127.0.0.1:35820 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1354026 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1354027 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1354028 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1354032 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@120cab55 name:ZooKeeperConnection Watcher:127.0.0.1:35820/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1354032 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1354033 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1354034 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1354036 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1354038 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1354039 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1354041 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1354042 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1354044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1354044 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37241_
[junit4] 2> 1354045 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:37241_
[junit4] 2> 1354046 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1354047 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1354048 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1354049 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37241_
[junit4] 2> 1354049 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1354051 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer Overseer (id=93990972823109637-127.0.0.1:37241_-n_0000000000) starting
[junit4] 2> 1354052 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1354058 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1354058 INFO (OverseerCollectionProcessor-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 1354058 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1354059 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1354062 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1354062 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1354063 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores
[junit4] 2> 1354064 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1354064 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/
[junit4] 2> 1354064 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1354065 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1354065 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1354065 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:37241_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1354065 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1354066 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1354066 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1354067 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:37241",
[junit4] 2> "node_name":"127.0.0.1:37241_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1354067 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:37241",
[junit4] 2> "node_name":"127.0.0.1:37241_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1354067 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1354067 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1354068 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1354069 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 1355066 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1355066 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1355067 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1355067 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1355067 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1355068 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/'
[junit4] 2> 1355079 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1355083 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1355086 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1355094 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1355095 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1355099 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1355199 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1355204 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1355205 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1355212 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1355214 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1355216 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1355216 WARN (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1355216 WARN (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1355216 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1355217 WARN (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1355217 WARN (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1355217 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1355217 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1355218 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1355218 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@12233757
[junit4] 2> 1355219 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/data
[junit4] 2> 1355219 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/data/index/
[junit4] 2> 1355219 WARN (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1355220 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/data/index
[junit4] 2> 1355220 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=5, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1355221 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4daa6b6b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ee8899),segFN=segments_1,generation=1}
[junit4] 2> 1355221 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1355221 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/data/
[junit4] 2> 1355221 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 1355224 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1355224 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1355225 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1355227 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1355228 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1355229 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1355229 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1355232 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1355232 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1355233 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1355233 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1355233 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1355234 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1355234 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=468990108, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1355235 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4daa6b6b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3ee8899),segFN=segments_1,generation=1}
[junit4] 2> 1355235 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1355235 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@720f60dd[collection1] main
[junit4] 2> 1355235 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 1355236 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1355236 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1355236 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1355236 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1355237 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1355237 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1355237 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1355237 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1355237 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1355238 INFO (searcherExecutor-2463-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@720f60dd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1355238 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1355238 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1355238 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1355238 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1503855566922973184
[junit4] 2> 1355240 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2 ms to seed version buckets with highest version 1503855566922973184
[junit4] 2> 1355240 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1355241 INFO (coreLoadExecutor-2462-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1355243 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:37241 collection:control_collection shard:shard1
[junit4] 2> 1355244 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1355247 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1355248 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1355248 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1355248 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1355249 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37241/collection1/
[junit4] 2> 1355249 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1355249 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1355249 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:37241/collection1/ has no replicas
[junit4] 2> 1355249 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37241/collection1/ shard1
[junit4] 2> 1355249 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1355252 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1355252 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:37241",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1355354 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1355356 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 1355402 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:37241/collection1/ and leader is http://127.0.0.1:37241/collection1/
[junit4] 2> 1355403 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:37241
[junit4] 2> 1355403 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1355403 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1355403 INFO (coreZkRegister-2456-thread-1-processing-n:127.0.0.1:37241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1355404 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1355405 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:37241",
[junit4] 2> "node_name":"127.0.0.1:37241_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1355405 INFO (OverseerStateUpdate-93990972823109637-127.0.0.1:37241_-n_0000000000) [n:127.0.0.1:37241_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:37241",
[junit4] 2> "node_name":"127.0.0.1:37241_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1355513 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1355514 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:37241_) [n:127.0.0.1:37241_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 1355566 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1355567 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1355568 INFO (zkCallback-600-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1006c26f name:ZooKeeperConnection Watcher:127.0.0.1:35820/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1355569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1355569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1355569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1355571 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1355845 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores/collection1
[junit4] 2> 1355846 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001
[junit4] 2> 1355847 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 1355849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a9b70b2{/,null,AVAILABLE}
[junit4] 2> 1355849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.ServerConnector Started ServerConnector@466e48d7{HTTP/1.1}{127.0.0.1:48920}
[junit4] 2> 1355849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.e.j.s.Server Started @1359037ms
[junit4] 2> 1355849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=48920, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores}
[junit4] 2> 1355850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 1355850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/'
[junit4] 2> 1355862 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/solr.xml
[junit4] 2> 1355866 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores
[junit4] 2> 1355867 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoreContainer New CoreContainer 86291410
[junit4] 2> 1355867 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/]
[junit4] 2> 1355867 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/lib
[junit4] 2> 1355867 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/lib).
[junit4] 2> 1355873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1355874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1355874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1355874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1355875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35820/solr
[junit4] 2> 1355875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1355875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1355875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1355877 INFO (zkCallback-602-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@21120100 name:ZooKeeperConnection Watcher:127.0.0.1:35820 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1355877 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1355878 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1355879 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1355880 INFO (zkCallback-603-thread-1-processing-n:127.0.0.1:48920_) [n:127.0.0.1:48920_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4b6a47d5 name:ZooKeeperConnection Watcher:127.0.0.1:35820/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1355880 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1355883 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1356886 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48920_
[junit4] 2> 1356889 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48920_
[junit4] 2> 1356893 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1356894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1356895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1356895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores
[junit4] 2> 1356896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1356896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[76A61FB8AE401695]) [n:127.0.0.1:48920_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_76A61FB8AE401695-001/shard-1-001/cores/collection1/
[junit4] 2> 1356896 INFO (T
[...truncated too long message...]
s.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4022426 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[76A61FB8AE401695]-worker) [n:127.0.0.1:57700_ c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 13, 2015 6:24:57 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=BlockTreeOrds(blocksize=128), range_facet_l_dv=FSTOrd50, _version_=BlockTreeOrds(blocksize=128), multiDefault=Lucene50(blocksize=128), a_t=BlockTreeOrds(blocksize=128), intDefault=BlockTreeOrds(blocksize=128), a_i1=BlockTreeOrds(blocksize=128), id=FSTOrd50, range_facet_i_dv=BlockTreeOrds(blocksize=128), text=PostingsFormat(name=Asserting), range_facet_l=BlockTreeOrds(blocksize=128), timestamp=BlockTreeOrds(blocksize=128)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_TN, timezone=Etc/GMT-3
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=260152464,total=525860864
[junit4] 2> NOTE: All tests run in this JVM: [FullSolrCloudDistribCmdsTest, TestSystemIdResolver, TestManagedSynonymFilterFactory, TestZkChroot, HdfsUnloadDistributedZkTest, TestFieldCollectionResource, TermVectorComponentDistributedTest, TestStressReorder, TestXIncludeConfig, TestHdfsUpdateLog, TestClassNameShortening, BJQParserTest, SynonymTokenizerTest, DirectUpdateHandlerTest, TestRawResponseWriter, TestQueryUtils, TestDynamicFieldResource, DistributedSuggestComponentTest, DistributedQueueTest, DistributedVersionInfoTest, DistributedFacetPivotLongTailTest, TestSolrQueryParser, TestImplicitCoreProperties, TestCollationField, TestExtendedDismaxParser, TestExactStatsCache, SaslZkACLProviderTest, TestReloadAndDeleteDocs, TestNonDefinedSimilarityFactory, DistributedFacetPivotLargeTest, LeaderFailoverAfterPartitionTest, TestPseudoReturnFields, TestCollectionAPI, TestManagedResource, SampleTest, ChangedSchemaMergeTest, TestExpandComponent, TestExactSharedStatsCache, LoggingHandlerTest, SharedFSAutoReplicaFailoverUtilsTest, SharedFSAutoReplicaFailoverTest, CircularListTest, TestConfigReload, BadIndexSchemaTest, StatsComponentTest, ConcurrentDeleteAndCreateCollectionTest, TestSchemaVersionResource, OutputWriterTest, TestRequestStatusCollectionAPI, TestChildDocTransformer, TestRebalanceLeaders, CursorMarkTest, AutoCommitTest, TestSolrJ, TestSimpleTrackingShardHandler, TestFileDictionaryLookup, OpenExchangeRatesOrgProviderTest, AnalyticsMergeStrategyTest, TestDefaultSimilarityFactory, SpellCheckCollatorTest, PathHierarchyTokenizerFactoryTest, SOLR749Test, CoreMergeIndexesAdminHandlerTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestDynamicLoading, TestExceedMaxTermLength, SuggesterTest, AnalyticsQueryTest, TestTrieFacet, MoreLikeThisHandlerTest, TestSchemaSimilarityResource, TestCSVResponseWriter, CoreAdminRequestStatusTest, TestInitQParser, TestCloudPivotFacet, QueryResultKeyTest, OverseerTest, FileBasedSpellCheckerTest, TestStressRecovery, QueryEqualityTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, RecoveryZkTest, TestReplicationHandler, ZkSolrClientTest, ZkCLITest, TestDistributedGrouping, ZkControllerTest, TestReload, HardAutoCommitTest, DistributedTermsComponentTest, SolrCoreTest, TestGroupingSearch, TestLazyCores, OverseerCollectionProcessorTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, DocValuesTest, SuggesterTSTTest, TestTrie, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, SortByFunctionTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestQueryTypes, TestOmitPositions, XmlUpdateRequestHandlerTest, TestIndexingPerformance, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, SearchHandlerTest, TestQuerySenderListener, TestQuerySenderNoQuery, ResponseLogComponentTest, MultiTermTest, TestDocSet, NumericFieldsTest, MinimalSchemaTest, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, SpellPossibilityIteratorTest, EchoParamsTest, TestIBSimilarityFactory, TestFastWriter, TimeZoneUtilsTest, URLClassifyProcessorTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, DOMUtilTest, ClusterStateTest, TestUtils, SystemInfoHandlerTest, FileUtilsTest, TestCursorMarkWithoutUniqueKey, TestJettySolrRunner, AliasIntegrationTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CollectionStateFormat2Test, DeleteShardTest, DistribCursorPagingTest, HttpPartitionTest, SSLMigrationTest, SolrCloudExampleTest, TestDownShardTolerantSearch, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [508/508] on J2 in 1060.68s, 1 test, 1 error <<< FAILURES!
[...truncated 14 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:512: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 508 suites, 2005 tests, 2 errors, 2 failures, 20 ignored (10 assumptions)
Total time: 172 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 717 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/717/
3 tests failed.
REGRESSION: org.apache.solr.search.TestSearcherReuse.test
Error Message:
expected same:<Searcher@600ad70c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}> was not:<Searcher@5de2c8cf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}>
Stack Trace:
java.lang.AssertionError: expected same:<Searcher@600ad70c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}> was not:<Searcher@5de2c8cf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}>
at __randomizedtesting.SeedInfo.seed([A7CE6FE98D323E8F:2F9A503323CE5377]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotSame(Assert.java:641)
at org.junit.Assert.assertSame(Assert.java:580)
at org.junit.Assert.assertSame(Assert.java:593)
at org.apache.solr.search.TestSearcherReuse.assertSearcherHasNotChanged(TestSearcherReuse.java:247)
at org.apache.solr.search.TestSearcherReuse.test(TestSearcherReuse.java:117)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=1910, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1910, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:47592, http://127.0.0.1:48781, http://127.0.0.1:52380, http://127.0.0.1:53657, http://127.0.0.1:35017]
at __randomizedtesting.SeedInfo.seed([A7CE6FE98D323E8F]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:896)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:47592, http://127.0.0.1:48781, http://127.0.0.1:52380, http://127.0.0.1:53657, http://127.0.0.1:35017]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47592: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
... 5 more
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=8172, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=8172, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42169/ntce/jk: Could not find collection : awholynewstresscollection_collection3_1
at __randomizedtesting.SeedInfo.seed([A7CE6FE98D323E8F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
Build Log:
[...truncated 10018 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/init-core-data-001
[junit4] 2> 149200 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A7CE6FE98D323E8F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 149200 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A7CE6FE98D323E8F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 149207 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 149215 INFO (Thread-988) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 149215 INFO (Thread-988) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 149308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkTestServer start zk server on port:57511
[junit4] 2> 149308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 149313 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149326 INFO (zkCallback-113-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c6697c8 name:ZooKeeperConnection Watcher:127.0.0.1:57511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 149327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 149330 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 149338 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149339 INFO (zkCallback-114-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@45ed3aec name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 149341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 149344 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 149347 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 149349 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 149351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 149351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 149356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 149356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 149359 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 149359 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 149361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 149362 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 149363 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 149364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 149365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 149366 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 149368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 149368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 149370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 149370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 149372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 149372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 149374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 149374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 149376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 149376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 149732 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1
[junit4] 2> 149740 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 149826 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f4046fd{/,null,AVAILABLE}
[junit4] 2> 149833 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5778e4ae{HTTP/1.1}{127.0.0.1:48781}
[junit4] 2> 149834 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server Started @153315ms
[junit4] 2> 149835 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/tempDir-001/control/data, hostContext=/, hostPort=48781, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores}
[junit4] 2> 149835 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 149838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/'
[junit4] 2> 149853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/solr.xml
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1406093189
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/]
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/lib
[junit4] 2> 149863 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/lib).
[junit4] 2> 149871 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 149874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 149874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57511/solr
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 149883 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149883 INFO (zkCallback-116-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@519d3021 name:ZooKeeperConnection Watcher:127.0.0.1:57511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149884 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149884 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 149890 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149893 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@100e4ab2 name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149893 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 149896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 149898 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 149899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 149901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 149902 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 149903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 149904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 149905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48781_
[junit4] 2> 149906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48781_
[junit4] 2> 149907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 149908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 149909 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 149909 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94030712546983939-127.0.0.1:48781_-n_0000000000
[junit4] 2> 149910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48781_
[junit4] 2> 149910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 149911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer Overseer (id=94030712546983939-127.0.0.1:48781_-n_0000000000) starting
[junit4] 2> 149914 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 149919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 149920 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 149922 INFO (OverseerCollectionProcessor-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 149931 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 149933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 149933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 149934 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores
[junit4] 2> 149935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 149935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/
[junit4] 2> 149935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 149936 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 149936 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 149938 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 149938 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 149938 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 149939 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 149939 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 149940 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 149940 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 149942 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149943 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 149944 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 149944 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 149944 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 149945 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 149945 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 149948 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 149949 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/'
[junit4] 2> 149973 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 149979 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 149983 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 149992 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 149993 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 149999 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 150123 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 150132 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 150133 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 150151 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 150153 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 150155 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 150156 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 150156 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 150156 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 150157 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 150157 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 150157 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 150157 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 150158 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 150158 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cb10baf
[junit4] 2> 150158 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data
[junit4] 2> 150159 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/index/
[junit4] 2> 150159 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 150160 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/index
[junit4] 2> 150161 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=966355182, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 150205 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f307b86),segFN=segments_1,generation=1}
[junit4] 2> 150205 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 150218 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 150220 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 150220 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 150220 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 150222 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150223 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150224 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150224 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/
[junit4] 2> 150225 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 150236 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150246 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 150246 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 150253 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 150253 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 150254 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 150254 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 150254 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=28.591796875, floorSegmentMB=0.76953125, forceMergeDeletesPctAllowed=8.925424591396729, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5246243728212946
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f307b86),segFN=segments_1,generation=1}
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@12b5816f[collection1] main
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504491401844359168
[junit4] 2> 150266 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2 ms to seed version buckets with highest version 1504491401844359168
[junit4] 2> 150266 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 150267 INFO (searcherExecutor-319-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@12b5816f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 150268 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 150284 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:48781 collection:control_collection shard:shard1
[junit4] 2> 150289 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 150295 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94030712546983939-core_node1-n_0000000000
[junit4] 2> 150296 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 150297 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150297 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 150297 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48781/collection1/
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48781/collection1/ has no replicas
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48781/collection1/ shard1
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 150299 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 150302 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150303 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 150405 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150406 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 150440 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:48781/collection1/ and leader is http://127.0.0.1:48781/collection1/
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48781
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 150455 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150456 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 150457 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 150464 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150473 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@631fb797 name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 150473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 150477 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 150478 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 150478 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 150489 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150492 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@af2102d name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150493 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150493 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 150495 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150498 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 150498 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 150501 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150509 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150512 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 150512 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 150614 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 150615 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150615 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150617 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 150620 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 150895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1
[junit4] 2> 150896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001
[junit4] 2> 150899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 150904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@423f58f5{/,null,AVAILABLE}
[junit4] 2> 150904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7feafcfd{HTTP/1.1}{127.0.0.1:53657}
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server Started @154385ms
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=53657, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores}
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/'
[junit4] 2> 150929 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/solr.xml
[junit4] 2> 150935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores
[junit4] 2> 150936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer New CoreContainer 930125312
[junit4] 2> 150936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/]
[junit4] 2> 150936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/lib
[junit4] 2> 150936 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/lib).
[junit4] 2> 150948 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57511/solr
[junit4] 2> 150951 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 150951 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 150952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150969 INFO (zkCallback-122-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e477909 name:ZooKeeperConnection Watcher:127.0.0.1:57511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150972 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150973 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 150982 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150983 INFO (zkCallback-123-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b316139 name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150983 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150987 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 151996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53657_
[junit4] 2> 151997 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53657_
[junit4] 2> 152005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 152005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94030712546983943-127.0.0.1:53657_-n_0000000001
[junit4] 2> 152006 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94030712546983939-127.0.0.1:48781_-n_0000000000 to know if I could be the leader
[junit4] 2> 152007 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 152007 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 152008 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores
[junit4] 2> 152009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 152009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1/
[junit4] 2> 152009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 152016 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 152016 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 152026 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 152026 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for external collection collection1
[junit4] 2> 152026 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 152026 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53657",
[junit4] 2> "node_name":"127.0.0.1:53657_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 152033 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 152033 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53657",
[junit4] 2> "node_name":"127.0.0.1:53657_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 152033 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 152033 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 152036 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0
[junit4] 2> 152036 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 152037 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 152037 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 152136 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 152137 INFO (zkCallback-123-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 152137 INFO (zkCallback-123-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 1
[junit4] 2> 153037 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 153037 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 153038 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 153038 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 153039 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 153039 INFO (coreLoadExecut
[...truncated too long message...]
DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 1444105 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[A7CE6FE98D323E8F]-worker) [n:127.0.0.1:37681_ntce%2Fjk c:addReplicaColl s:shard1 r:core_node4 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 20, 2015 6:28:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=FST50, range_facet_l_dv=Lucene50(blocksize=128), _version_=FST50, multiDefault=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=LuceneFixedGap), intDefault=FST50, a_i1=PostingsFormat(name=LuceneFixedGap), id=Lucene50(blocksize=128), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), text=Lucene50(blocksize=128), range_facet_l=PostingsFormat(name=LuceneFixedGap), timestamp=PostingsFormat(name=LuceneFixedGap)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=es_CL, timezone=America/Cayenne
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=208105816,total=534249472
[junit4] 2> NOTE: All tests run in this JVM: [AutoCommitTest, TestCursorMarkWithoutUniqueKey, TestBinaryResponseWriter, SolrCoreCheckLockOnStartupTest, ActionThrottleTest, SpellCheckCollatorTest, TestDefaultSimilarityFactory, PrimUtilsTest, QueryParsingTest, TestDownShardTolerantSearch, SolrXmlInZkTest, RegexBoostProcessorTest, JavabinLoaderTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestSolrQueryParser, OverseerRolesTest, QueryEqualityTest, TestSolrDynamicMBean, TestZkChroot, HdfsDirectoryTest, TestCopyFieldCollectionResource, OverseerTest, TestInitQParser, TestSolrQueryParserDefaultOperatorResource, SearchHandlerTest, DocValuesTest, ResponseLogComponentTest, DirectUpdateHandlerTest, TestDistribDocBasedVersion, TestExceedMaxTermLength, CleanupOldIndexTest, TestAuthorizationFramework, DistributedFacetPivotSmallTest, AnalyticsMergeStrategyTest, TestReplicationHandlerBackup, TestReload, TestSchemaNameResource, SuggesterTest, TestShortCircuitedRequests, TestSystemIdResolver, OpenExchangeRatesOrgProviderTest, TestSolrQueryParserResource, DOMUtilTest, NotRequiredUniqueKeyTest, TestCSVResponseWriter, DistribCursorPagingTest, OutOfBoxZkACLAndCredentialsProvidersTest, LeaderElectionTest, DeleteLastCustomShardedReplicaTest, DistributedQueueTest, PolyFieldTest, TestRebalanceLeaders, SoftAutoCommitTest, VMParamsZkACLAndCredentialsProvidersTest, TestUtils, OverriddenZkACLAndCredentialsProvidersTest, TestSolr4Spatial2, CustomCollectionTest, TestStressRecovery, TestXIncludeConfig, DistributedSuggestComponentTest, PathHierarchyTokenizerFactoryTest, TestNoOpRegenerator, TestRawResponseWriter, BadIndexSchemaTest, TestMaxScoreQueryParser, TestSearcherReuse, SolrIndexSplitterTest, TestMiniSolrCloudCluster, TestLuceneMatchVersion, SampleTest, FullSolrCloudDistribCmdsTest, UnloadDistributedZkTest, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [218/512] on J2 in 358.22s, 1 test, 1 error <<< FAILURES!
[...truncated 964 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 512 suites, 2015 tests, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 177 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 716 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/716/
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=16497, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16497, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
at __randomizedtesting.SeedInfo.seed([E7088F6DFBD3183F]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:896)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1572)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38217/uxupv: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
... 7 more
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=8693, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=8693, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:60005: Could not find collection : awholynewstresscollection_collection4_0
at __randomizedtesting.SeedInfo.seed([E7088F6DFBD3183F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
Build Log:
[...truncated 10806 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/init-core-data-001
[junit4] 2> 933962 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 933962 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 934004 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 934026 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 934031 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 934043 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_35902_hdfs____gyekub/webapp
[junit4] 2> 934149 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 934508 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35902
[junit4] 2> 934622 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 934624 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 934640 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_47695_datanode____449m8m/webapp
[junit4] 2> 934740 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 935107 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:47695
[junit4] 2> 935186 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 935188 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 935226 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_53978_datanode____.4ts9st/webapp
[junit4] 2> 935315 INFO (IPC Server handler 3 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-b0b9e55f-383d-46e5-8b5c-03f2431dafb6 node DatanodeRegistration(127.0.0.1, datanodeUuid=42f45d32-9bfd-4dc7-972e-7eb1e18ec80c, infoPort=47695, ipcPort=38522, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 935315 INFO (IPC Server handler 3 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-e7de499e-f237-4c46-8a46-2d987e5f524e node DatanodeRegistration(127.0.0.1, datanodeUuid=42f45d32-9bfd-4dc7-972e-7eb1e18ec80c, infoPort=47695, ipcPort=38522, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 935366 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 935770 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53978
[junit4] 2> 935897 INFO (IPC Server handler 4 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-edfe2ceb-132c-47af-bc8a-bf72808443c9 node DatanodeRegistration(127.0.0.1, datanodeUuid=181437a4-8240-4b47-9a6d-cba07753b1f9, infoPort=53978, ipcPort=38807, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 935898 INFO (IPC Server handler 4 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-e993263d-e9c8-4617-affd-8042c1d7aa84 node DatanodeRegistration(127.0.0.1, datanodeUuid=181437a4-8240-4b47-9a6d-cba07753b1f9, infoPort=53978, ipcPort=38807, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 935953 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 935953 INFO (Thread-3270) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 935953 INFO (Thread-3270) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 936053 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkTestServer start zk server on port:42582
[junit4] 2> 936054 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936054 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936057 INFO (zkCallback-766-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@638a3ab6 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936057 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936057 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936057 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 936060 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936062 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936062 INFO (zkCallback-767-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d96fc65 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936063 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936063 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936063 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 936065 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 936067 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 936068 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 936070 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 936070 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 936072 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 936073 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 936074 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936075 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936076 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 936076 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 936078 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 936078 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 936079 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 936080 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 936081 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 936082 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 936083 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 936083 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 936085 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 936085 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 936086 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 936087 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 936088 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 936088 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 936090 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936091 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936092 INFO (zkCallback-768-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ad08d52 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936094 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936094 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936103 INFO (zkCallback-769-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4047aa63 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 936106 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936107 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936118 INFO (zkCallback-770-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bb041c9 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936118 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936119 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936119 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 936119 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 936125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 936125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 936133 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 936133 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 936135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936136 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 936136 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 936137 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 936137 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 936138 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 936139 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 936140 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 936140 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 936141 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 936141 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 936142 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 936142 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 936144 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 936144 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 936145 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 936145 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 936436 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1
[junit4] 2> 936438 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 936440 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6085d6d{/,null,AVAILABLE}
[junit4] 2> 936444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@154da174{SSL-http/1.1}{127.0.0.1:50440}
[junit4] 2> 936444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server Started @939601ms
[junit4] 2> 936444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:39691/hdfs__localhost_39691__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001_tempDir-002_control_data, hostContext=/, hostPort=50440, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores}
[junit4] 2> 936446 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 936446 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/'
[junit4] HEARTBEAT J0 PID(26478@lucene1-us-west): 2015-06-19T20:23:26, stalled for 300s at: TestDistributedSearch.test
[junit4] 2> 936460 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/solr.xml
[junit4] 2> 936465 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores
[junit4] 2> 936465 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer New CoreContainer 979576554
[junit4] 2> 936466 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/]
[junit4] 2> 936466 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/lib
[junit4] 2> 936466 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/lib).
[junit4] 2> 936473 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 936475 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 936476 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 936476 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 936476 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42582/solr
[junit4] 2> 936477 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 936477 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936482 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936484 INFO (zkCallback-772-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@768ee744 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936485 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936485 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936488 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936489 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1debbac0 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936489 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936490 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 936491 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 936492 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 936494 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 936495 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 936498 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 936499 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 936500 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 936501 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50440_
[junit4] 2> 936501 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50440_
[junit4] 2> 936502 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 936503 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 936505 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 936509 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94028379560280070-127.0.0.1:50440_-n_0000000000
[junit4] 2> 936510 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50440_
[junit4] 2> 936510 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 936511 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer Overseer (id=94028379560280070-127.0.0.1:50440_-n_0000000000) starting
[junit4] 2> 936514 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 936518 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 936518 INFO (OverseerCollectionProcessor-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 936519 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 936519 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 936522 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 936522 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 936523 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores
[junit4] 2> 936524 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 936524 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/
[junit4] 2> 936524 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 936526 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 936526 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 936526 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 936526 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 936527 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 936527 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 936527 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 936528 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 936528 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 936528 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 936531 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 936532 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 937527 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 937527 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 937528 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 937528 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 937529 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 937529 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/'
[junit4] 2> 937542 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 937546 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 937549 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 937557 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 937558 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 937562 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 937653 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 937658 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 937659 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 937667 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 937669 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 937671 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 937671 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 937671 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 937672 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 937672 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 937672 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 937672 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39691/solr_hdfs_home
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e17ab
[junit4] 2> 937674 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 937719 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
[junit4] 2> 937719 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 937721 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 937732 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 937732 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 937748 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
[junit4] 2> 937748 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 937749 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=166353292, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 937785 INFO (IPC Server handler 3 on 39691) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42076 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b0b9e55f-383d-46e5-8b5c-03f2431dafb6:NORMAL:127.0.0.1:33526|RBW], ReplicaUnderConstruction[[DISK]DS-edfe2ceb-132c-47af-bc8a-bf72808443c9:NORMAL:127.0.0.1:42076|RBW]]} size 0
[junit4] 2> 937790 INFO (IPC Server handler 5 on 39691) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33526 is added to blk_1073741825_1001 size 71
[junit4] 2> 937793 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b6c5b335 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5873e64; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 937793 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 937811 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 937811 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 937811 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 937813 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 937814 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937815 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937816 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937817 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937820 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 937820 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 937821 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 937821 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 937833 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 937833 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 937835 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=76.5771484375, floorSegmentMB=1.470703125, forceMergeDeletesPctAllowed=24.302973055038148, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b6c5b335 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5873e64; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7e33941c[collection1] main
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 937865 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 937865 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 937865 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 937866 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 937866 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 937866 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 937867 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 937867 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 937867 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 937868 INFO (searcherExecutor-2296-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7e33941c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 937870 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 937870 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504454074973552640
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1 ms to seed version buckets with highest version 1504454074973552640
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 937873 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 937874 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:50440 collection:control_collection shard:shard1
[junit4] 2> 937875 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 937878 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94028379560280070-core_node1-n_0000000000
[junit4] 2> 937879 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 937880 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 937880 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 937880 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 937880 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:50440/collection1/
[junit4] 2> 937880 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:50440/collection1/ has no replicas
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:50440/collection1/ shard1
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 937884 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 937884 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 937988 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 937990 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 938030 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 938031 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 938032 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@610a971a name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 938032 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 938032 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 938032 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 938035 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:50440/collection1/ and leader is https://127.0.0.1:50440/collection1/
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50440
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 938035 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 938035 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 938037 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 938037 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 938038 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 938038 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 938042 INFO (zkCallback-776-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c719a70 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 938042 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 938042 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 938049 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 938054 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 938055 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 938055 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938056 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 938065 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938071 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 938158 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 938159 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938159 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938160 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 938162 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 938361 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/cores/collection1
[junit4] 2> 938362 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001
[junit4] 2> 938363 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 938365 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1aca0984{/,null,AVAILABLE}
[junit4] 2> 938368 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5c065822{SSL-http/1.1}{127.0.0.1:52260}
[junit4] 2> 938369 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server Started @941525ms
[junit4] 2> 938369 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:39691/hdfs__localhost_39691__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=52260, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/cores}
[junit4] 2> 938370 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 938370 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/'
[junit4] 2> 938384 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/solr.xml
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/cores
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1035470588
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/]
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/lib
[junit4] 2> 938390 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/lib).
[junit4] 2> 938397 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 938399 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42582/solr
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 938402 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 938403 INFO (zkCallback-778-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3eaf9e95 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 938404 I
[...truncated too long message...]
che.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > ... 7 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16493, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
[junit4] > at __randomizedtesting.SeedInfo.seed([E7088F6DFBD3183F]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:896)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:38217/uxupv
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:572)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > ... 5 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:466)
[junit4] > ... 9 more
[junit4] 2> 2110201 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [n:127.0.0.1:59222_uxupv c:awholynewstresscollection_collection4_0 s:shard2 r:core_node16 x:awholynewstresscollection_collection4_0_shard2_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=PostingsFormat(name=Memory doPackFST= true), range_facet_l_dv=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=Memory doPackFST= true), multiDefault=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=Memory doPackFST= true), a_i1=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Asserting), range_facet_i_dv=PostingsFormat(name=MockRandom), text=FSTOrd50, range_facet_l=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=DefaultSimilarity, locale=ar_IQ, timezone=America/Porto_Acre
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=1,free=104141880,total=534249472
[junit4] 2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, TestComplexPhraseQParserPlugin, HttpPartitionTest, CoreAdminHandlerTest, ClusterStateUpdateTest, ZkCLITest, TestNRTOpen, TestMacros, HighlighterMaxOffsetTest, BlockCacheTest, TestFieldTypeCollectionResource, TestLMDirichletSimilarityFactory, TestSolrCoreProperties, TestSortingResponseWriter, MigrateRouteKeyTest, TestOmitPositions, TestFieldSortValues, TestJsonRequest, TestConfigSets, TestCoreContainer, TestWriterPerf, IndexSchemaRuntimeFieldTest, NoCacheHeaderTest, TestLRUStatsCache, StatelessScriptUpdateProcessorFactoryTest, HdfsThreadLeakTest, ShowFileRequestHandlerTest, ParsingFieldUpdateProcessorsTest, SolrCmdDistributorTest, UUIDUpdateProcessorFallbackTest, BaseCdcrDistributedZkTest, TriLevelCompositeIdRoutingTest, TestOverriddenPrefixQueryForCustomFieldType, FieldMutatingUpdateProcessorTest, EchoParamsTest, ShardRoutingCustomTest, TestRTGBase, TestSearchPerf, SpellCheckComponentTest, HdfsRecoveryZkTest, TestFastLRUCache, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestAtomicUpdateErrorCases, TestCryptoKeys, TestSolrConfigHandlerConcurrent, RAMDirectoryFactoryTest, TestManagedSchema, TestRemoveLastDynamicCopyField, SolrPluginUtilsTest, DocumentAnalysisRequestHandlerTest, TestAnalyzedSuggestions, BufferStoreTest, TestDefaultStatsCache, TestManagedSchemaFieldTypeResource, TestReplicaProperties, TestFuzzyAnalyzedSuggestions, SystemInfoHandlerTest, HdfsWriteToMultipleCollectionsTest, ConvertedLegacyTest, TestCloudManagedSchema, TestDynamicLoading, SpatialFilterTest, AlternateDirectoryTest, HdfsChaosMonkeySafeLeaderTest, ScriptEngineTest, TestRandomMergePolicy, BadComponentTest, PreAnalyzedUpdateProcessorTest, TestManagedSchemaDynamicFieldResource, TestExpandComponent, CachingDirectoryFactoryTest, CopyFieldTest, TestCustomSort, TestLeaderElectionZkExpiry, TestTolerantSearch, TestRecoveryHdfs, TestCharFilters, CurrencyFieldOpenExchangeTest, RequestLoggingTest, TestEmbeddedSolrServerConstructors, ReturnFieldsTest, CacheHeaderTest, DistributedMLTComponentTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [240/512] on J1 in 895.99s, 1 test, 1 error <<< FAILURES!
[...truncated 875 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 512 suites, 2015 tests, 2 errors, 20 ignored (10 assumptions)
Total time: 256 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 715 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/715/
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
323 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=17732, name=searcherExecutor-4411-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=18458, name=qtp699233344-18458, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=16148, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120) 4) Thread[id=18243, name=coreZkRegister-3175-thread-18, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=18400, name=coreZkRegister-3349-thread-40-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=15977, name=searcherExecutor-3253-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=18300, name=coreZkRegister-3197-thread-29, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=18188, name=coreZkRegister-3186-thread-9-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=18359, name=coreZkRegister-3186-thread-25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=18343, name=zkCallback-909-thread-29, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 11) Thread[id=19433, name=searcherExecutor-4568-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12) Thread[id=19223, name=coreZkRegister-3197-thread-64, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=17638, name=searcherExecutor-4384-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=17680, name=searcherExecutor-4395-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 15) Thread[id=19356, name=coreZkRegister-3349-thread-68-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard5_replica1 s:shard5 c:awholynewstresscollection_collection2_4 r:core_node32, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 16) Thread[id=18186, name=coreZkRegister-3186-thread-7-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17) Thread[id=16123, name=searcherExecutor-3366-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18) Thread[id=17514, name=qtp215754624-17514, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 19) Thread[id=19729, name=RecoveryThread-awholynewstresscollection_collection5_4_shard7_replica4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429) at java.util.concurrent.FutureTask.get(FutureTask.java:191) at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:598) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:361) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) 20) Thread[id=18661, name=qtp639560314-18661, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 21) Thread[id=15920, name=searcherExecutor-3220-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 22) Thread[id=17454, name=qtp1764830233-17454, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 23) Thread[id=19277, name=coreZkRegister-3349-thread-57-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard5_replica1 s:shard5 c:awholynewstresscollection_collection2_4 r:core_node32, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 24) Thread[id=15963, name=searcherExecutor-3240-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 25) Thread[id=19547, name=searcherExecutor-4620-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 26) Thread[id=19688, name=qtp639560314-19688, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 27) Thread[id=15862, name=org.eclipse.jetty.server.session.HashSessionManager@49ef4326Timer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 28) Thread[id=19352, name=coreZkRegister-3349-thread-64, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 29) Thread[id=18132, name=coreZkRegister-3349-thread-24, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 30) Thread[id=18555, name=qtp699233344-18555, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 31) Thread[id=19125, name=zkCallback-873-thread-15-processing-n:127.0.0.1:48979__wgo-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 32) Thread[id=19696, name=zkCallback-873-thread-76-processing-n:127.0.0.1:48979__wgo, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 33) Thread[id=18128, name=coreZkRegister-3349-thread-20-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 34) Thread[id=18275, name=zkCallback-909-thread-25-processing-n:127.0.0.1:44719__wgo, state=BLOCKED, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 35) Thread[id=15861, name=Scheduler-393793085, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 36) Thread[id=18278, name=zkCallback-876-thread-32, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 37) Thread[id=17470, name=qtp639560314-17470, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController.register(ZkController.java:839) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:187) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:216) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:629) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:683) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:649) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:628) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:213) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:193) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:654) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:433) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 38) Thread[id=19119, name=zkCallback-873-thread-15-processing-n:127.0.0.1:48979__wgo-SendThread(127.0.0.1:44215), state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 39) Thread[id=19210, name=coreZkRegister-3197-thread-59-processing-n:127.0.0.1:33469__wgo x:awholynewstresscollection_collection2_4_shard7_replica2 s:shard7 c:awholynewstresscollection_collection2_4 r:core_node12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 40) Thread[id=18232, name=coreZkRegister-3175-thread-9, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 41) Thread[id=17551, name=qtp639560314-17551, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 42) Thread[id=19173, name=coreZkRegister-3186-thread-51, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 43) Thread[id=19244, name=coreZkRegister-3186-thread-52-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 44) Thread[id=19535, name=searcherExecutor-4605-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 45) Thread[id=16089, name=org.eclipse.jetty.server.session.HashSessionManager@48dd0c49Timer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 46) Thread[id=19576, name=searcherExecutor-4640-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 47) Thread[id=19692, name=zkCallback-873-thread-73, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 48) Thread[id=19477, name=RecoveryThread-awholynewcollection_0_shard2_replica1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:511) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) 49) Thread[id=19172, name=coreZkRegister-3186-thread-50, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 50) Thread[id=16267, name=searcherExecutor-3414-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 51) Thread[id=17110, name=qtp639560314-17110, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 52) Thread[id=18389, name=coreZkRegister-3349-thread-32-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:683) at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:652) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:980) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 53) Thread[id=19166, name=coreZkRegister-3186-thread-47-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=BLOCKED, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:299) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:478) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:330) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 54) Thread[id=19691, name=zkCallback-870-thread-64, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.common.cloud.ZkStateReader$7.process(ZkStateReader.java:938) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 55) Thread[id=19391, name=searcherExecutor-4532-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 56) Thread[id=18387, name=coreZkRegister-3349-thread-30-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=BLOCKED, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:299) at org.apache.solr.cloud.ZkController.checkRecovery(ZkController.java:1095) at org.apache.solr.cloud.ZkController.register(ZkController.java:929) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 57) Thread[id=18199, name=coreZkRegister-3186-thread-20, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 58) Thread[id=15919, name=searcherExecutor-3219-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 59) Thread[id=15983, name=searcherExecutor-3282-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 60) Thread[id=18167, name=coreZkRegister-3197-thread-23, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 61) Thread[id=17206, name=searcherExecutor-4167-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 62) Thread[id=18361, name=coreZkRegister-3186-thread-27-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ActionThrottle.minimumWaitBetweenActions(ActionThrottle.java:82) at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:326) at org.apache.solr.cloud.ZkController.checkRecovery(ZkController.java:1095) at org.apache.solr.cloud.ZkController.register(ZkController.java:929) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 63) Thread[id=17499, name=qtp215754624-17499, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController.register(ZkController.java:839) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:187) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:216) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:629) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:683) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:649) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:628) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:213) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:193) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:654) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:433) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 64) Thread[id=19736, name=zkCallback-870-thread-67, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.common.cloud.ZkStateReader$7.process(ZkStateReader.java:938) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 65) Thread[id=18116, name=coreZkRegister-3349-thread-11-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 66) Thread[id=18239, name=coreZkRegister-3175-thread-15-processing-n:127.0.0.1:43783__wgo x:awholynewstresscollection_collection2_4_shard2_replica1 s:shard2 c:awholynewstresscollection_collection2_4 r:core_node9, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:683) at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:652) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:980) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 67) Thread[id=19733, name=RecoveryThread-awholynewstresscollection_collection0_4_shard1_replica3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429) at java.util.concurrent.FutureTask.get(FutureTask.java:191) at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:598) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:361) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) 68) Thread[id=19567, name=searcherExecutor-4663-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 69) Thread[id=19243, name=zkCallback-876-thread-77, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 70) Thread[id=18334, name=coreZkRegister-3197-thread-39-processing-n:127.0.0.1:33469__wgo x:awholynewstresscollection_collection2_4_shard7_replica2 s:shard7 c:awholynewstresscollection_collection2_4 r:core_node12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 71) Thread[id=16081, name=qtp639560314-16081-selector-ServerConnectorManager@759ecdc5/1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 72) Thread[id=19164, name=coreZkRegister-3186-thread-45-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34) at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:136) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:315) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 73) Thread[id=19293, name=coreZkRegister-3175-thread-26, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 74) Thread[id=19205, name=coreZkRegister-3197-thread-54, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 75) Thread[id=19162, name=coreZkRegister-3186-thread-43, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 76) Thread[id=18184, name=coreZkRegister-3186-thread-6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 77) Thread[id=17469, name=qtp215754624-17469, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 78) Thread[id=17490, name=qtp699233344-17490, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 79) Thread[id=19208, name=coreZkRegister-3197-thread-57, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 80) Thread[id=18229, name=coreZkRegister-3175-thread-6-processing-n:127.0.0.1:43783__wgo x:awholynewstresscollection_collection2_4_shard2_replica1 s:shard2 c:awholynewstresscollection_collection2_4 r:core_node9, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:683) at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:652) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:959) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 81) Thread[id=19633, name=OverseerCollectionProcessor-94018458300252292-127.0.0.1:33469__wgo-n_0000000016, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320) at org.apache.solr.cloud.DistributedQueue.peekTopN(DistributedQueue.java:447) at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:317) at java.lang.Thread.run(Thread.java:745) 82) Thread[id=18526, name=qtp699233344-18526, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 83) Thread[id=19735, name=zkCallback-870-thread-66, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.common.cloud.ZkStateReader$7.process(ZkStateReader.java:938) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 84) Thread[id=18119, name=coreZkRegister-3349-thread-14-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 85) Thread[id=19171, name=coreZkRegister-3186-thread-49, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 86) Thread[id=18390, name=coreZkRegister-3349-thread-33-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 87) Thread[id=19214, name=coreZkRegister-3197-thread-63, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 88) Thread[id=16104, name=Thread-11296, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1095) 89) Thread[id=19247, name=coreZkRegister-3186-thread-54-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ActionThrottle.minimumWaitBetweenActions(ActionThrottle.java:82) at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:326) at org.apache.solr.cloud.ZkController.checkRecovery(ZkController.java:1095) at org.apache.solr.cloud.ZkController.register(ZkController.java:929) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 90) Thread[id=17682, name=searcherExecutor-4390-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 91) Thread[id=18122, name=coreZkRegister-3197-thread-12-processing-n:127.0.0.1:33469__wgo x:awholynewstresscollection_collection2_4_shard7_replica2 s:shard7 c:awholynewstresscollection_collection2_4 r:core_node12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 92) Thread[id=19435, name=searcherExecutor-4558-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 93) Thread[id=19695, name=zkCallback-873-thread-75, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 94) Thread[id=17720, name=searcherExecutor-4421-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread
[...truncated too long message...]
.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 240) Thread[id=18163, name=coreZkRegister-3197-thread-21, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 241) Thread[id=18192, name=coreZkRegister-3186-thread-13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 242) Thread[id=16139, name=Scheduler-1744411394, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 243) Thread[id=19584, name=searcherExecutor-4664-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 244) Thread[id=19449, name=searcherExecutor-4566-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 245) Thread[id=17715, name=searcherExecutor-4420-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 246) Thread[id=15907, name=Scheduler-23691200, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 247) Thread[id=19635, name=zkCallback-870-thread-63, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([5E4A046F50D6BFE0]:0)
[junit4] Completed [263/512] on J1 in 1186.58s, 1 test, 3 errors <<< FAILURES!
[...truncated 762 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 512 suites, 2014 tests, 2 suite-level errors, 2 errors, 888 ignored (9 assumptions)
Total time: 168 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 714 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/714/
3 tests failed.
REGRESSION: org.apache.solr.TestDistributedSearch.test
Error Message:
Captured an uncaught exception in thread: Thread[id=166959, name=Thread-161371, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=166959, name=Thread-161371, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:54645//collection1: java.lang.NullPointerException
at org.apache.solr.search.grouping.distributed.responseprocessor.StoredFieldsShardResponseProcessor.process(StoredFieldsShardResponseProcessor.java:42)
at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:744)
at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:727)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:388)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2057)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:648)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:452)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([A67B788F5276F3EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.TestDistributedSearch$1.run(TestDistributedSearch.java:1110)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=3934, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3934, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:47394/gxnp: collection already exists: awholynewstresscollection_collection5_0
at __randomizedtesting.SeedInfo.seed([A67B788F5276F3EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1570)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1591)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=29485, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=29485, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36343/jkwc/id: Could not find collection : awholynewstresscollection_collection1_0
at __randomizedtesting.SeedInfo.seed([A67B788F5276F3EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10302 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/init-core-data-001
[junit4] 2> 374176 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A67B788F5276F3EF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 374177 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A67B788F5276F3EF]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /gxnp/
[junit4] 2> 374186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 374189 INFO (Thread-1369) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 374189 INFO (Thread-1369) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 374289 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkTestServer start zk server on port:54627
[junit4] 2> 374289 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374305 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374326 INFO (zkCallback-509-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a0a95da name:ZooKeeperConnection Watcher:127.0.0.1:54627 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 374332 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374338 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374350 INFO (zkCallback-510-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d7b84ba name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 374353 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 374358 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 374360 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 374362 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 374362 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 374364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 374364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 374367 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 374368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 374369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 374369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 374371 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 374371 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 374373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 374373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 374375 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 374375 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 374381 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 374381 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 374383 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 374383 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 374385 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 374386 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 374388 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 374388 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 374391 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374394 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374395 INFO (zkCallback-511-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a4273cb name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374395 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374395 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374715 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1
[junit4] 2> 374718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 374724 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@68ad8b78{/gxnp,null,AVAILABLE}
[junit4] 2> 374734 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6e82d2f8{SSL-http/1.1}{127.0.0.1:59974}
[junit4] 2> 374735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server Started @378492ms
[junit4] 2> 374735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/tempDir-001/control/data, hostContext=/gxnp, hostPort=59974, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores}
[junit4] 2> 374738 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 374739 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/'
[junit4] 2> 374762 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/solr.xml
[junit4] 2> 374770 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores
[junit4] 2> 374770 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer New CoreContainer 78553720
[junit4] 2> 374771 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/]
[junit4] 2> 374771 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/lib
[junit4] 2> 374771 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/lib).
[junit4] 2> 374780 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 374787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 374790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 374790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 374790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54627/solr
[junit4] 2> 374791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 374791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374795 INFO (zkCallback-513-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5be85332 name:ZooKeeperConnection Watcher:127.0.0.1:54627 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374795 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374795 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374802 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374838 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@28c8a332 name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374839 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 374841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 374843 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 374844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 374845 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 374847 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 374848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 374849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 374849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59974_gxnp
[junit4] 2> 374850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59974_gxnp
[junit4] 2> 374851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 374852 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 374853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 374853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94012701380378628-127.0.0.1:59974_gxnp-n_0000000000
[junit4] 2> 374854 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59974_gxnp
[junit4] 2> 374854 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 374855 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer Overseer (id=94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) starting
[junit4] 2> 374856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 374870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 374873 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 374886 INFO (OverseerCollectionProcessor-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 374901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 374903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 374903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 374904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores
[junit4] 2> 374905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 374905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/
[junit4] 2> 374905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 374911 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 374911 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 374913 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 374917 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 374917 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 374918 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 374918 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 374918 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 374919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 374919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 374920 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 374921 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 375913 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 375913 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 375914 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 375914 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 375915 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 375915 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/'
[junit4] 2> 375928 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 375934 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 375937 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 375958 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 375959 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 375965 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 376057 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 376063 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 376065 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 376074 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 376077 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 376079 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 376079 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 376080 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 376080 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 376080 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 376080 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 376080 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 376081 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 376081 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 376081 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bd97d4
[junit4] 2> 376082 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data
[junit4] 2> 376082 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/index/
[junit4] 2> 376082 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 376083 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/index
[junit4] 2> 376083 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=33.0634765625, floorSegmentMB=1.396484375, forceMergeDeletesPctAllowed=24.399196593063046, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2049409071727861
[junit4] 2> 376084 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20ce86c4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d83e640),segFN=segments_1,generation=1}
[junit4] 2> 376084 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 376085 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/
[junit4] 2> 376088 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 376092 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376093 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376094 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376095 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376098 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 376099 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 376099 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 376099 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 376100 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 376100 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 376101 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=97.3349609375, floorSegmentMB=0.39453125, forceMergeDeletesPctAllowed=11.768434559546574, segmentsPerTier=13.0, maxCFSSegmentSizeMB=1.4609375, noCFSRatio=0.2478076390394219
[junit4] 2> 376101 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20ce86c4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d83e640),segFN=segments_1,generation=1}
[junit4] 2> 376101 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 376102 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1172d511[collection1] main
[junit4] 2> 376102 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 376105 INFO (searcherExecutor-1287-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1172d511[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504203224093032448
[junit4] 2> 376108 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1504203224093032448
[junit4] 2> 376108 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 376108 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 376109 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:59974/gxnp collection:control_collection shard:shard1
[junit4] 2> 376110 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 376113 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94012701380378628-core_node1-n_0000000000
[junit4] 2> 376113 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 376118 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:59974/gxnp/collection1/
[junit4] 2> 376119 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:59974/gxnp/collection1/ has no replicas
[junit4] 2> 376120 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:59974/gxnp/collection1/ shard1
[junit4] 2> 376120 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 376123 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 376124 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 376226 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 376227 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:59974/gxnp/collection1/ and leader is https://127.0.0.1:59974/gxnp/collection1/
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:59974/gxnp
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 376277 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 376278 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 376279 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 376384 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 376386 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 376422 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 376423 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 376424 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3fda7395 name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 376424 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 376425 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 376425 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 376427 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 376785 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1
[junit4] 2> 376787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001
[junit4] 2> 376788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 376791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@977cf82{/gxnp,null,AVAILABLE}
[junit4] 2> 376794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.ServerConnector Started ServerConnector@50872e97{SSL-http/1.1}{127.0.0.1:45991}
[junit4] 2> 376794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server Started @380552ms
[junit4] 2> 376794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/gxnp, hostPort=45991, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores}
[junit4] 2> 376796 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 376796 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/'
[junit4] 2> 376810 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/solr.xml
[junit4] 2> 376814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores
[junit4] 2> 376814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer New CoreContainer 1666041875
[junit4] 2> 376815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/]
[junit4] 2> 376815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/lib
[junit4] 2> 376815 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/lib).
[junit4] 2> 376821 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 376823 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54627/solr
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 376826 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 376827 INFO (zkCallback-518-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7708d399 name:ZooKeeperConnection Watcher:127.0.0.1:54627 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 376827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 376828 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 376829 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 376830 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f521ed9 name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 376830 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 376834 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 377837 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45991_gxnp
[junit4] 2> 377838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:45991_gxnp
[junit4] 2> 377840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 377841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94012701380378631-127.0.0.1:45991_gxnp-n_0000000001
[junit4] 2> 377842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94012701380378628-127.0.0.1:59974_gxnp-n_0000000000 to know if I could be the leader
[junit4] 2> 377842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 377842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 377843 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores
[junit4] 2> 377844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 377844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1/
[junit4] 2> 377844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 377845 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 377845 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 377845 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 377846 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 377846 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45991/gxnp",
[junit4] 2> "node_name":"127.0.0.1:45991_gxnp",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 377847 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45991/gxnp",
[junit4] 2> "node_name":"127.0.0.1:45991_gxnp",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 377847 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 377847 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 377851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 377851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 377949 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 377949 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 377949 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 377951 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 377951 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 377951 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 378846 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 378847 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1/'
[junit4] 2> 378863 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 378867 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 378871 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 378880 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 378881 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 378886 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 378984 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 378990 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 378991 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 378999 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 379002 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 379004 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 379005 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 379005 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 379005 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 379006 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 379006 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 379006 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 379006 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirec
[...truncated too long message...]
it4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4290292 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[A67B788F5276F3EF]-worker) [n:127.0.0.1:36343_jkwc%2Fid c:addReplicaColl s:shard2 r:core_node2 x:addReplicaColl_shard2_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 17, 2015 2:51:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene53, sim=DefaultSimilarity, locale=hu, timezone=Australia/Queensland
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=205835792,total=522715136
[junit4] 2> NOTE: All tests run in this JVM: [ShardRoutingCustomTest, TestAnalyzeInfixSuggestions, TestManagedSchemaDynamicFieldResource, BlockDirectoryTest, TestSolrCoreProperties, IndexSchemaRuntimeFieldTest, ReplicationFactorTest, TestSchemaNameResource, ChaosMonkeySafeLeaderTest, DistributedQueryComponentOptimizationTest, TestStressVersions, TestDownShardTolerantSearch, TestAuthenticationFramework, TestTolerantSearch, BadCopyFieldTest, DistributedMLTComponentTest, DeleteLastCustomShardedReplicaTest, TestJettySolrRunner, CollectionsAPIAsyncDistributedZkTest, DocumentBuilderTest, TestCryptoKeys, SpellingQueryConverterTest, RuleEngineTest, TestCharFilters, NoCacheHeaderTest, TestBulkSchemaConcurrent, TestCollationFieldDocValues, ZkCLITest, TestExpandComponent, SolrPluginUtilsTest, HighlighterMaxOffsetTest, AddBlockUpdateTest, ReturnFieldsTest, HdfsThreadLeakTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestOmitPositions, TestOverriddenPrefixQueryForCustomFieldType, CollectionsAPIDistributedZkTest, ShardSplitTest, SaslZkACLProviderTest, TestComponentsName, TestCoreContainer, TestFastLRUCache, TestDynamicLoading, SpatialHeatmapFacetsTest, OverseerStatusTest, TestCoreDiscovery, SolrXmlInZkTest, TestCloudSchemaless, TestManagedResourceStorage, TestComplexPhraseQParserPlugin, JavabinLoaderTest, TestStressUserVersions, DocValuesMultiTest, HttpPartitionTest, ResourceLoaderTest, SpellCheckComponentTest, StatelessScriptUpdateProcessorFactoryTest, SolrCloudExampleTest, DistributedQueryComponentCustomSortTest, TestBulkSchemaAPI, TestBlobHandler, TestLRUCache, AlternateDirectoryTest, HdfsBasicDistributedZk2Test, TestSolrConfigHandlerCloud, TestSuggestSpellingConverter, TestRemoveLastDynamicCopyField, TestJsonRequest, DistributedExpandComponentTest, DistanceFunctionTest, ZkSolrClientTest, TestSolrConfigHandlerConcurrent, BadComponentTest, MigrateRouteKeyTest, TestHashPartitioner, ClusterStateUpdateTest, TestManagedSchemaFieldTypeResource, TestSearchPerf, PreAnalyzedFieldTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestRandomFaceting, TestZkChroot, TestDistributedGrouping, TestReload, SimpleFacetsTest, TestGroupingSearch, ConvertedLegacyTest, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestIndexSearcher, SoftAutoCommitTest, SolrRequestParserTest, DocValuesTest, TestTrie, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, TestRemoteStreaming, CacheHeaderTest, LukeRequestHandlerTest, TestWriterPerf, PrimitiveFieldTypeTest, XmlUpdateRequestHandlerTest, RequiredFieldsTest, TestArbitraryIndexDir, IndexSchemaTest, JSONWriterTest, TestAnalyzedSuggestions, TestPHPSerializedResponseWriter, TestBinaryResponseWriter, SOLR749Test, UpdateParamsTest, CopyFieldTest, ResponseLogComponentTest, SolrIndexConfigTest, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestDocSet, MinimalSchemaTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, PrimUtilsTest, DateFieldTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, TestRTGBase, DistributedIntervalFacetingTest, CloudExitableDirectoryReaderTest, CustomCollectionTest, LeaderFailoverAfterPartitionTest, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestRebalanceLeaders, VMParamsZkACLAndCredentialsProvidersTest, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [511/511] on J1 in 953.58s, 1 test, 1 error <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 511 suites, 2012 tests, 3 errors, 20 ignored (10 assumptions)
Total time: 180 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 713 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/713/
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]
at __randomizedtesting.SeedInfo.seed([547BEA79E2A6115B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:235)
at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest.test
Error Message:
shard1 is not consistent. Got 168 from http://127.0.0.1:51292/collection1lastClient and got 150 from http://127.0.0.1:47576/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 168 from http://127.0.0.1:51292/collection1lastClient and got 150 from http://127.0.0.1:47576/collection1
at __randomizedtesting.SeedInfo.seed([547BEA79E2A6115B:DC2FD5A34C5A7CA3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1242)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1221)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:165)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:39630: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39630: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:309)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:437)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:176)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=5546, name=collection2, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5546, name=collection2, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41432/tf/h: Could not find collection : awholynewstresscollection_collection2_0
at __randomizedtesting.SeedInfo.seed([547BEA79E2A6115B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10610 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/init-core-data-001
[junit4] 2> 2055073 INFO (SUITE-HttpPartitionTest-seed#[547BEA79E2A6115B]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 2055080 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2055080 INFO (Thread-5334) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2055080 INFO (Thread-5334) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2055180 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkTestServer start zk server on port:36393
[junit4] 2> 2055180 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2055186 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055195 INFO (zkCallback-1806-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@36b9343d name:ZooKeeperConnection Watcher:127.0.0.1:36393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055195 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055196 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2055196 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2055204 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2055209 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055209 INFO (zkCallback-1807-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c11ead6 name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055210 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055210 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2055210 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2055216 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2055218 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2055222 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2055229 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2055229 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2055233 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2055234 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2055237 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2055237 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2055241 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2055242 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2055247 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2055247 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2055250 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2055250 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2055251 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2055252 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2055253 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2055253 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2055254 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2055254 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2055256 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2055256 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2055257 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2055257 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2055809 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1
[junit4] 2> 2055813 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 2055820 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ba6e5e7{/,null,AVAILABLE}
[junit4] 2> 2055821 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@313eaa6{HTTP/1.1}{127.0.0.1:53699}
[junit4] 2> 2055821 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server Started @2058941ms
[junit4] 2> 2055821 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/tempDir-001/control/data, hostContext=/, hostPort=52375, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores}
[junit4] 2> 2055822 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 2055822 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/'
[junit4] 2> 2055872 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/solr.xml
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer New CoreContainer 790998541
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/]
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/lib
[junit4] 2> 2055879 WARN (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/lib).
[junit4] 2> 2055890 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2055892 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2055893 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2055894 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2055897 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36393/solr
[junit4] 2> 2055897 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2055897 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2055898 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055911 INFO (zkCallback-1809-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d2eac0b name:ZooKeeperConnection Watcher:127.0.0.1:36393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055911 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055912 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2055913 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x14dfc4ca8530002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2055914 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055915 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b4b133b name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055915 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055917 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2055919 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2055923 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2055928 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2055931 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2055933 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2055940 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2055943 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2055944 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52375_
[junit4] 2> 2055945 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52375_
[junit4] 2> 2055951 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2055954 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2055955 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2055956 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94008573416374275-127.0.0.1:52375_-n_0000000000
[junit4] 2> 2055957 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52375_
[junit4] 2> 2055957 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2055960 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer Overseer (id=94008573416374275-127.0.0.1:52375_-n_0000000000) starting
[junit4] 2> 2055966 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2055978 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2055979 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2055979 INFO (OverseerCollectionProcessor-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 2055980 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2055990 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2055991 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2055991 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores
[junit4] 2> 2055992 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2055992 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/
[junit4] 2> 2055992 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2055995 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2055996 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2055996 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2055996 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2055996 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2055999 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2056000 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2056001 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2056001 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2056005 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2056011 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 2056015 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2056996 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2056997 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2056997 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2056997 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2056998 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2056999 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/'
[junit4] 2> 2057022 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2057046 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2057049 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2057059 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2057060 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2057069 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2057188 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2057195 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2057196 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2057210 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2057212 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2057216 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2057217 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2057218 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2057219 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2057220 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2057221 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e9e4449
[junit4] 2> 2057222 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data
[junit4] 2> 2057222 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/index/
[junit4] 2> 2057222 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2057223 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/index
[junit4] 2> 2057223 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=714039037, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2057223 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@56242e20 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e161143),segFN=segments_1,generation=1}
[junit4] 2> 2057224 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2057225 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/
[junit4] 2> 2057225 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2057230 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2057231 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2057231 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2057233 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2057233 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2057237 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057238 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057239 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057241 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057246 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2057246 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2057247 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2057247 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2057249 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2057249 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2057249 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=27.9072265625, floorSegmentMB=2.193359375, forceMergeDeletesPctAllowed=1.6415820687032423, segmentsPerTier=36.0, maxCFSSegmentSizeMB=2.1064453125, noCFSRatio=0.6217567923197758
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@56242e20 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e161143),segFN=segments_1,generation=1}
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@36169850[collection1] main
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2057252 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2057252 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2057252 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2057254 INFO (searcherExecutor-3434-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@36169850[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2057255 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504137176933203968
[junit4] 2> 2057257 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1504137176933203968
[junit4] 2> 2057257 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2057258 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2057259 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:52375 collection:control_collection shard:shard1
[junit4] 2> 2057260 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2057267 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94008573416374275-core_node1-n_0000000000
[junit4] 2> 2057270 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 2057272 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2057272 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2057273 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52375/collection1/
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:52375/collection1/ has no replicas
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52375/collection1/ shard1
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2057281 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2057282 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2057385 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057387 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:52375/collection1/ and leader is http://127.0.0.1:52375/collection1/
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52375
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2057435 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2057436 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2057437 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2057438 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2057502 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2057506 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2057507 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e31aa25 name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2057507 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2057507 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2057508 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2057514 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2057541 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057543 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057543 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 2057545 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 2058031 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1
[junit4] 2> 2058032 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001
[junit4] 2> 2058033 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d8a0af4{/,null,AVAILABLE}
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@69d8feb2{HTTP/1.1}{127.0.0.1:45010}
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server Started @2061160ms
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=54994, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores}
[junit4] 2> 2058041 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 2058041 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/'
[junit4] 2> 2058063 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/solr.xml
[junit4] 2> 2058068 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores
[junit4] 2> 2058068 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer New CoreContainer 926539785
[junit4] 2> 2058069 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/]
[junit4] 2> 2058069 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/lib
[junit4] 2> 2058069 WARN (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/lib).
[junit4] 2> 2058095 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2058096 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36393/solr
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2058098 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2058100 INFO (zkCallback-1814-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4751fc09 name:ZooKeeperConnection Watcher:127.0.0.1:36393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2058101 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2058101 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2058104 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2058105 INFO (zkCallback-1815-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@78777c91 name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2058105 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2058114 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2059119 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54994_
[junit4] 2> 2059119 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54994_
[junit4] 2> 2059126 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2059126 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94008573416374278-127.0.0.1:54994_-n_0000000001
[junit4] 2> 2059128 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94008573416374275-127.0.0.1:52375_-n_0000000000 to know if I could be the leader
[junit4] 2> 2059128 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2059128 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2059129 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores
[junit4] 2> 2059130 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2059130 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1/
[junit4] 2> 2059130 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2059132 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2059132 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2059134 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2059134 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2059135 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2059136 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2059137 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54994",
[junit4] 2> "node_name":"127.0.0.1:54994_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 2059139 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54994",
[junit4] 2> "node_name":"127.0.0.1:54994_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2059139 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2059139 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 2059140 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2059140 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2059140 INFO (zkCallback-1815-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2059141 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 2059142 INFO (zkCallback-1815-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 2059143 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 2060135 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2060136 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 2060137 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2060137 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 2060137 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2060138 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1/'
[junit4] 2> 2060163 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2060170 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2060174 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2060186 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2060187 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2060193 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2060321 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2060330 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2060332 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2060343 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2060346 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2060350 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2060351 WARN (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2060352 WARN (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2060352 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[juni
[...truncated too long message...]
le.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4006585 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[547BEA79E2A6115B]-worker) [n:127.0.0.1:48730_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_547BEA79E2A6115B-001
[junit4] 2> Jun 16, 2015 8:49:03 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=sq, timezone=Pacific/Wallis
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=3,free=255404328,total=516947968
[junit4] 2> NOTE: All tests run in this JVM: [TestHighlightDedupGrouping, TestDynamicFieldResource, TestSolrConfigHandler, TestRemoteStreaming, TestStandardQParsers, CSVRequestHandlerTest, TestDynamicFieldCollectionResource, TestBadConfig, TestIBSimilarityFactory, DeleteInactiveReplicaTest, LeaderElectionIntegrationTest, ClusterStateTest, RequestHandlersTest, HighlighterTest, TestDistributedMissingSort, TestWordDelimiterFilterFactory, TestDocBasedVersionConstraints, MergeStrategyTest, TestRestoreCore, HdfsDirectoryFactoryTest, SolrRequestParserTest, RemoteQueryErrorTest, SolrTestCaseJ4Test, TestRandomFaceting, TestRestManager, TestAddFieldRealTimeGet, TestCodecSupport, RulesTest, TestFieldResource, TestMacros, TestBinaryField, DistributedFacetPivotWhiteBoxTest, SpatialRPTFieldTypeTest, TestManagedSynonymFilterFactory, StandardRequestHandlerTest, BaseCdcrDistributedZkTest, TestHighFrequencyDictionaryFactory, TestSolr4Spatial, SegmentsInfoRequestHandlerTest, TestJmxIntegration, SolrIndexConfigTest, TestCloudManagedSchema, TestRealTimeGet, TestCloudInspectUtil, SyncSliceTest, SchemaVersionSpecificBehaviorTest, PingRequestHandlerTest, TestUpdate, TestFreeTextSuggestions, TermsComponentTest, BasicZkTest, TestInfoStreamLogging, TestCSVLoader, ExternalFileFieldSortTest, TestTrackingShardHandlerFactory, DistributedFacetPivotLongTailTest, TestBlendedInfixSuggestions, TestReRankQParserPlugin, TestCollapseQParserPlugin, ChaosMonkeyNothingIsSafeTest, HdfsRecoverLeaseTest, AliasIntegrationTest, SimpleCollectionCreateDeleteTest, LeaderFailoverAfterPartitionTest, SolrCoreTest, TestIndexingPerformance, ParsingFieldUpdateProcessorsTest, SignatureUpdateProcessorFactoryTest, HighlighterConfigTest, TimeZoneUtilsTest, MBeansHandlerTest, DateFieldTest, MultiTermTest, UUIDFieldTest, DistributedIntervalFacetingTest, ResponseHeaderTest, CdcrUpdateLogTest, DeleteShardTest, ExitableDirectoryReaderTest, TestRangeQuery, DistributedSpellCheckComponentTest, SuggesterWFSTTest, BasicDistributedZkTest, OverseerTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, ShardRoutingCustomTest, TestDistributedSearch, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestHashPartitioner, ZkControllerTest, TestJoin, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, SimpleFacetsTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, TestFunctionQuery, TestLazyCores, OverseerCollectionProcessorTest, SoftAutoCommitTest, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, SpellCheckCollatorTest, SuggesterFSTTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTSTTest, SuggesterTest, TestStressLucene, SpatialFilterTest, NoCacheHeaderTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, QueryEqualityTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestReversedWildcardFilterFactory, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TestValueSourceCache, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaTest, TestCollationField, UpdateRequestProcessorFactoryTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestComponentsName, SearchHandlerTest, TestQuerySenderListener, TestSolrIndexConfig, CopyFieldTest, TestStressRecovery, TestMergePolicyConfig, SampleTest, TestDocSet, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, ResourceLoaderTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, DateMathParserTest, PreAnalyzedFieldTest, SpellingQueryConverterTest, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, CursorPagingTest, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, AssignTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, ConnectionManagerTest, CustomCollectionTest, DeleteReplicaTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, DistribJoinFromCollectionTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnCommitTest, MultiThreadedOCPTest, RecoveryAfterSoftCommitTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCloudPivotFacet, TestCollectionAPI, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestMiniSolrCloudCluster, HdfsChaosMonkeySafeLeaderTest]
[junit4] Completed [418/511] on J0 in 141.42s, 1 test, 1 failure <<< FAILURES!
[...truncated 309 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 511 suites, 2010 tests, 1 suite-level error, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 228 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 712 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/712/
3 tests failed.
REGRESSION: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#3): CloudJettyRunner [url=http://127.0.0.1:51233/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#3): CloudJettyRunner [url=http://127.0.0.1:51233/collection1]
at __randomizedtesting.SeedInfo.seed([1F34ED704AEF5E07:9760D2AAE41333FF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=27341, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=27341, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49624: collection already exists: awholynewstresscollection_collection2_4
at __randomizedtesting.SeedInfo.seed([1F34ED704AEF5E07]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1570)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1591)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=27041, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=27041, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59389: Could not find collection : awholynewstresscollection_collection4_1
at __randomizedtesting.SeedInfo.seed([1F34ED704AEF5E07]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10798 lines...]
[junit4] Suite: org.apache.solr.cloud.RollingRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/init-core-data-001
[junit4] 2> 1648068 INFO (SUITE-RollingRestartTest-seed#[1F34ED704AEF5E07]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1648068 INFO (SUITE-RollingRestartTest-seed#[1F34ED704AEF5E07]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1648071 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1648071 INFO (Thread-7351) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1648071 INFO (Thread-7351) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1648171 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkTestServer start zk server on port:36878
[junit4] 2> 1648183 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1648185 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1648187 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1648189 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1648190 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1648192 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1648193 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1648195 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1648196 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1648198 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1648199 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1648538 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1
[junit4] 2> 1648540 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 1648543 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4722754c{/,null,AVAILABLE}
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.ServerConnector Started ServerConnector@21ef0578{HTTP/1.1}{127.0.0.1:35362}
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server Started @1652055ms
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/tempDir-001/control/data, hostContext=/, hostPort=35362, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores}
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/'
[junit4] 2> 1648559 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/solr.xml
[junit4] 2> 1648565 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores
[junit4] 2> 1648566 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer New CoreContainer 783154129
[junit4] 2> 1648566 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/]
[junit4] 2> 1648566 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/lib
[junit4] 2> 1648566 WARN (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/lib).
[junit4] 2> 1648573 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1648574 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36878/solr
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1648607 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35362_
[junit4] 2> 1648610 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1648610 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94003654443401219-127.0.0.1:35362_-n_0000000000
[junit4] 2> 1648611 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35362_
[junit4] 2> 1648612 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer Overseer (id=94003654443401219-127.0.0.1:35362_-n_0000000000) starting
[junit4] 2> 1648620 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1648633 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1648634 INFO (OverseerCollectionProcessor-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 1648653 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1648653 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1648654 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores
[junit4] 2> 1648655 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1648655 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/
[junit4] 2> 1648655 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1648670 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1648670 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1648670 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1648677 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1648677 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1648678 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1648678 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1648681 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1648681 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1648681 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1649671 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1649671 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1649671 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1649672 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/'
[junit4] 2> 1649686 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1649692 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1649695 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1649702 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1649703 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1649708 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1649792 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1649797 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1649798 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1649805 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1649807 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1649809 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1649810 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1649810 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1649810 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1649810 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1649811 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1649811 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1649811 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1649817 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1649817 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@10adf93f
[junit4] 2> 1649818 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data
[junit4] 2> 1649818 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index/
[junit4] 2> 1649819 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1649819 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index
[junit4] 2> 1649819 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1649831 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1649831 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1649831 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/
[junit4] 2> 1649834 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1649834 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1649836 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1649837 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649838 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649839 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649840 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649843 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1649843 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1649844 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1649844 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1649845 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1649845 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1649845 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1649846 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1649846 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1649846 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@575e7f1d[collection1] main
[junit4] 2> 1649847 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1649848 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1649848 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1649848 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504058472957739008
[junit4] 2> 1649852 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2 ms to seed version buckets with highest version 1504058472957739008
[junit4] 2> 1649852 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1649853 INFO (searcherExecutor-3826-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@575e7f1d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1649853 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1649857 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:35362 collection:control_collection shard:shard1
[junit4] 2> 1649861 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94003654443401219-core_node1-n_0000000000
[junit4] 2> 1649862 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1649863 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1649863 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1649864 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1649864 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1649865 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35362/collection1/
[junit4] 2> 1649865 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1649866 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:35362/collection1/ has no replicas
[junit4] 2> 1649866 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35362/collection1/ shard1
[junit4] 2> 1649873 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1649874 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1650019 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:35362/collection1/ and leader is http://127.0.0.1:35362/collection1/
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35362
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1650021 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1650022 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1650022 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1650196 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1650197 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1650199 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1650201 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 1650201 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1650303 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1650502 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1
[junit4] 2> 1650503 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001
[junit4] 2> 1650504 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 1650505 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@487cf7f8{/,null,AVAILABLE}
[junit4] 2> 1650506 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3b67a466{HTTP/1.1}{127.0.0.1:42913}
[junit4] 2> 1650506 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server Started @1654018ms
[junit4] 2> 1650506 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=42913, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores}
[junit4] 2> 1650507 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 1650507 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/'
[junit4] 2> 1650529 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/solr.xml
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer New CoreContainer 673817990
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/]
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/lib
[junit4] 2> 1650534 WARN (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/lib).
[junit4] 2> 1650548 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1650549 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36878/solr
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1651564 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42913_
[junit4] 2> 1651568 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1651568 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94003654443401223-127.0.0.1:42913_-n_0000000001
[junit4] 2> 1651569 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94003654443401219-127.0.0.1:35362_-n_0000000000 to know if I could be the leader
[junit4] 2> 1651569 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1651570 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1651570 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores
[junit4] 2> 1651571 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1651571 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/
[junit4] 2> 1651571 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1651573 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1651573 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1651573 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1651573 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1651574 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1651574 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for external collection collection1
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42913",
[junit4] 2> "node_name":"127.0.0.1:42913_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42913",
[junit4] 2> "node_name":"127.0.0.1:42913_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1651576 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1651677 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1652576 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1652577 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1652577 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1652578 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/'
[junit4] 2> 1652592 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1652600 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1652603 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1652620 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1652622 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1652628 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1652717 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1652724 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1652726 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1652733 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1652736 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1652738 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1652739 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1652739 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1652739 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1652740 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1652740 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1652740 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1652741 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1652741 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1652741 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@10adf93f
[junit4] 2> 1652742 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data
[junit4] 2> 1652743 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1652743 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1652743 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1652744 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1652755 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1652756 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1652756 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/
[junit4] 2> 1652761 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1652761 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1652761 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1652763 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1652763 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1652765 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652767 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652768 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652769 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652775 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1652776 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1652785 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1652786 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1652787 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1652787 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1652787 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1652788 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1652788 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1652789 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5b368bf2[collection1] main
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1652792 INFO (searcherExecutor-3837-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5b368bf2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1652792 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1652793 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1652793 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1652793 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504058476043698176
[junit4] 2> 1652796 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1504058476043698176
[junit4] 2> 1652796 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1652796 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1652797 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:42913 collection:collection1 shard:shard2
[junit4] 2> 1652801 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard2/election/94003654443401223-core_node1-n_0000000000
[junit4] 2> 1652802 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard2
[junit4] 2> 1652803 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1652804 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1652804 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 1652804 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1652805 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42913/collection1/
[junit4] 2> 1652805 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 1
[junit4] 2> 1652805 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1652806 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42913/collection1/ has no replicas
[junit4] 2> 1652806 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42913/collection1/ shard2
[junit4] 2> 1652809 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1652810 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:42913",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 1652811 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 2
[junit4] 2> 1652860 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:42913/collection1/ and leader is http://127.
[...truncated too long message...]
] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4289190 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1F34ED704AEF5E07]-worker) [n:127.0.0.1:56511_ c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 15, 2015 12:09:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=BlockTreeOrds(blocksize=128), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=BlockTreeOrds(blocksize=128), multiDefault=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), intDefault=BlockTreeOrds(blocksize=128), a_i1=PostingsFormat(name=Asserting), id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=PostingsFormat(name=Asserting), text=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=zh_TW, timezone=Etc/Greenwich
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=43731328,total=529006592
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedStatsComponentCardinality, RAMDirectoryFactoryTest, TestConfigOverlay, SpellPossibilityIteratorTest, TestLRUCache, TestSerializedLuceneMatchVersion, OverseerRolesTest, TestTrieFacet, AnalyticsQueryTest, InfoHandlerTest, TestAtomicUpdateErrorCases, ConcurrentDeleteAndCreateCollectionTest, TestRandomMergePolicy, TestImplicitCoreProperties, TestFieldCollectionResource, TestManagedResource, TestSolrDeletionPolicy2, NoCacheHeaderTest, TestComponentsName, TestFieldSortValues, TestHashPartitioner, OutOfBoxZkACLAndCredentialsProvidersTest, DocumentAnalysisRequestHandlerTest, SpellingQueryConverterTest, TestCoreDiscovery, ZkControllerTest, TestFuzzyAnalyzedSuggestions, TestIndexSearcher, DistributedExpandComponentTest, OpenCloseCoreStressTest, TestAuthorizationFramework, ResourceLoaderTest, IndexSchemaRuntimeFieldTest, RequiredFieldsTest, ShardRoutingTest, TestCollationFieldDocValues, TestManagedSchemaDynamicFieldResource, ScriptEngineTest, TestStressUserVersions, CopyFieldTest, SuggesterTSTTest, JSONWriterTest, TestSolrCoreProperties, TestLMJelinekMercerSimilarityFactory, TestSolrConfigHandlerCloud, HdfsNNFailoverTest, TestSchemaResource, TestManagedSchema, TestRTGBase, CacheHeaderTest, DistanceFunctionTest, HighlighterMaxOffsetTest, CollectionReloadTest, ChangedSchemaMergeTest, ConvertedLegacyTest, FileUtilsTest, TestExceedMaxTermLength, SolrCloudExampleTest, DistributedVersionInfoTest, TestLMDirichletSimilarityFactory, TestRandomRequestDistribution, TestReplicaProperties, CoreAdminRequestStatusTest, AddSchemaFieldsUpdateProcessorFactoryTest, AnalyticsMergeStrategyTest, RequestLoggingTest, TestWriterPerf, TestFastLRUCache, TestSearchPerf, HdfsDirectoryTest, TestShardHandlerFactory, DisMaxRequestHandlerTest, VMParamsZkACLAndCredentialsProvidersTest, PreAnalyzedFieldTest, ShowFileRequestHandlerTest, TestSchemaSimilarityResource, WordBreakSolrSpellCheckerTest, CloudExitableDirectoryReaderTest, TestNamedUpdateProcessors, RollingRestartTest, AutoCommitTest, TestDistributedGrouping, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestStressReorder, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, HighlighterTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, TestStressLucene, SpatialFilterTest, TestCSVLoader, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, LukeRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, TestOmitPositions, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, SolrPluginUtilsTest, TestCollationField, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, PingRequestHandlerTest, TestLFUCache, TestHighlightDedupGrouping, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CollectionStateFormat2Test, DistribCursorPagingTest, LeaderInitiatedRecoveryOnCommitTest, MigrateRouteKeyTest, RemoteQueryErrorTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudPivotFacet, TestCollectionAPI, TestDistribDocBasedVersion, TestLeaderElectionZkExpiry, TestRequestStatusCollectionAPI, TestShortCircuitedRequests, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [510/510] on J1 in 1111.57s, 1 test, 1 error <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 510 suites, 2009 tests, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 206 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 711 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/711/
3 tests failed.
REGRESSION: org.apache.solr.search.TestSearcherReuse.test
Error Message:
expected same:<Searcher@5ade40b5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1) Uninverting(_3(6.0.0):C1) Uninverting(_4(6.0.0):C1)))}> was not:<Searcher@410633d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1) Uninverting(_3(6.0.0):C1) Uninverting(_4(6.0.0):C1)))}>
Stack Trace:
java.lang.AssertionError: expected same:<Searcher@5ade40b5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1) Uninverting(_3(6.0.0):C1) Uninverting(_4(6.0.0):C1)))}> was not:<Searcher@410633d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1) Uninverting(_3(6.0.0):C1) Uninverting(_4(6.0.0):C1)))}>
at __randomizedtesting.SeedInfo.seed([79C93828E5BF5909:F19D07F24B4334F1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotSame(Assert.java:641)
at org.junit.Assert.assertSame(Assert.java:580)
at org.junit.Assert.assertSame(Assert.java:593)
at org.apache.solr.search.TestSearcherReuse.assertSearcherHasNotChanged(TestSearcherReuse.java:247)
at org.apache.solr.search.TestSearcherReuse.test(TestSearcherReuse.java:117)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=19293, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19293, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:44324: collection already exists: awholynewstresscollection_collection5_0
at __randomizedtesting.SeedInfo.seed([79C93828E5BF5909]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1570)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1591)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=870, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=870, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51887/hun/d: Could not find collection : awholynewstresscollection_collection0_0
at __randomizedtesting.SeedInfo.seed([79C93828E5BF5909]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10323 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/init-core-data-001
[junit4] 2> 6534 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 6535 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /hun/d
[junit4] 2> 8121 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 9658 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 9912 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
[junit4] 2> 9922 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 10016 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 10067 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_33147_hdfs____gxweda/webapp
[junit4] 2> 10220 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 11183 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33147
[junit4] 2> 12243 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 12251 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 12268 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_49655_datanode____koc2zc/webapp
[junit4] 2> 12433 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 13068 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:49655
[junit4] 2> 13426 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 13428 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 13462 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_42490_datanode____kqdawk/webapp
[junit4] 2> 13625 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 14214 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[79C93828E5BF5909]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42490
[junit4] 2> 14483 INFO (IPC Server handler 6 on 45475) [ ] BlockStateChange BLOCK* processReport: from storage DS-1f05cb9d-bd22-43a2-a189-23b2b4b67b1e node DatanodeRegistration(127.0.0.1, datanodeUuid=5d39964b-30dc-4d8e-943d-1948ce589640, infoPort=42490, ipcPort=46836, storageInfo=lv=-56;cid=testClusterID;nsid=537570246;c=0), blocks: 0, hasStaleStorages: true, processing time: 3 msecs
[junit4] 2> 14488 INFO (IPC Server handler 5 on 45475) [ ] BlockStateChange BLOCK* processReport: from storage DS-24a87a82-19ac-4bc4-96dd-206473a05763 node DatanodeRegistration(127.0.0.1, datanodeUuid=a1f939a6-6f67-4ecb-9b3e-739647715d3f, infoPort=49655, ipcPort=40446, storageInfo=lv=-56;cid=testClusterID;nsid=537570246;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
[junit4] 2> 14492 INFO (IPC Server handler 5 on 45475) [ ] BlockStateChange BLOCK* processReport: from storage DS-5ca5e86d-286f-4805-b8ee-5543387acbe6 node DatanodeRegistration(127.0.0.1, datanodeUuid=a1f939a6-6f67-4ecb-9b3e-739647715d3f, infoPort=49655, ipcPort=40446, storageInfo=lv=-56;cid=testClusterID;nsid=537570246;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 14498 INFO (IPC Server handler 6 on 45475) [ ] BlockStateChange BLOCK* processReport: from storage DS-ad1d6452-d818-4c20-988c-e6cf79168452 node DatanodeRegistration(127.0.0.1, datanodeUuid=5d39964b-30dc-4d8e-943d-1948ce589640, infoPort=42490, ipcPort=46836, storageInfo=lv=-56;cid=testClusterID;nsid=537570246;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 15487 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 15490 INFO (Thread-114) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 15490 INFO (Thread-114) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 15589 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ZkTestServer start zk server on port:43352
[junit4] 2> 15605 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 15642 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 15679 INFO (zkCallback-2-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70988871 name:ZooKeeperConnection Watcher:127.0.0.1:43352 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 15680 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 15680 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 15682 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 15713 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 15714 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 15716 INFO (zkCallback-3-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@135aba27 name:ZooKeeperConnection Watcher:127.0.0.1:43352/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 15716 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 15717 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 15723 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 15736 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 15740 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 15743 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 15750 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 15758 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 15777 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 15777 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 15782 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 15782 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 15792 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 15795 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 15802 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 15802 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 15805 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 15806 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 15809 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 15809 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 15812 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 15812 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 15817 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 15818 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 15821 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 15821 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 15824 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 15824 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 16192 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores/collection1
[junit4] 2> 16221 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.u.log Logging initialized @19295ms
[junit4] 2> 16365 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 16483 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8163594{/hun/d,null,AVAILABLE}
[junit4] 2> 16498 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7eca7320{HTTP/1.1}{127.0.0.1:51887}
[junit4] 2> 16499 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.Server Started @19573ms
[junit4] 2> 16503 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:45475/hdfs__localhost_45475__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001_tempDir-002_control_data, hostContext=/hun/d, hostPort=51887, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores}
[junit4] 2> 16509 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 16509 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/'
[junit4] 2> 16532 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/solr.xml
[junit4] 2> 16550 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores
[junit4] 2> 16551 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoreContainer New CoreContainer 1760956372
[junit4] 2> 16551 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/]
[junit4] 2> 16552 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/lib
[junit4] 2> 16552 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/lib).
[junit4] 2> 16586 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 16589 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 16589 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 16590 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 16590 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43352/solr
[junit4] 2> 16608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 16608 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 16609 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 16616 INFO (zkCallback-5-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6bf8f379 name:ZooKeeperConnection Watcher:127.0.0.1:43352 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 16621 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 16622 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 16648 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@440b646b name:ZooKeeperConnection Watcher:127.0.0.1:43352/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 16631 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 16651 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 16666 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 16674 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 16681 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 16685 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 16691 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 16707 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 16724 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 16727 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 16729 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51887_hun%2Fd
[junit4] 2> 16735 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51887_hun%2Fd
[junit4] 2> 16741 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 16751 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 16761 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 16789 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51887_hun%2Fd
[junit4] 2> 16789 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 16792 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer Overseer (id=93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) starting
[junit4] 2> 16799 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 16824 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 16828 INFO (OverseerCollectionProcessor-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 16829 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 16835 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 16859 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 16861 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 16862 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores
[junit4] 2> 16866 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 16867 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores/collection1/
[junit4] 2> 16867 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 16875 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 16876 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 16877 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 16877 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 16883 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 16883 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 16889 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51887/hun/d",
[junit4] 2> "node_name":"127.0.0.1:51887_hun%2Fd",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 16900 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51887/hun/d",
[junit4] 2> "node_name":"127.0.0.1:51887_hun%2Fd",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 16901 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 16912 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 16920 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 16928 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 17886 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 17886 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 17891 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 17891 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 17895 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 17895 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores/collection1/'
[junit4] 2> 17946 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 17968 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 17983 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 18010 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 18014 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 18073 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 18382 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 18391 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 18394 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 18452 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 18460 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 18467 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 18470 WARN (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 18471 WARN (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 18471 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 18476 WARN (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 18476 WARN (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 18478 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 18479 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 18490 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:45475/solr_hdfs_home
[junit4] 2> 18491 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 18491 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 18493 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@175f9ebd
[junit4] 2> 18508 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 18638 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
[junit4] 2> 18638 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 18647 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 18752 WARN (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:45475/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 18762 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 18804 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
[junit4] 2> 18805 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 18806 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=6, maxMergeAtOnceExplicit=7, maxMergedSegmentMB=12.5947265625, floorSegmentMB=1.6845703125, forceMergeDeletesPctAllowed=2.654371572902531, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.28226008910424505
[junit4] 2> 19220 INFO (IPC Server handler 1 on 45475) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42852 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-1f05cb9d-bd22-43a2-a189-23b2b4b67b1e:NORMAL:127.0.0.1:37437|RBW], ReplicaUnderConstruction[[DISK]DS-5ca5e86d-286f-4805-b8ee-5543387acbe6:NORMAL:127.0.0.1:42852|RBW]]} size 71
[junit4] 2> 19221 INFO (IPC Server handler 2 on 45475) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37437 is added to blk_1073741825_1001 size 71
[junit4] 2> 19637 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b771b66d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c406934; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 19638 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 19645 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:45475/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 19653 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 19670 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 19671 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 19671 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 19678 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 19678 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 19678 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 19680 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 19680 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 19688 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 19699 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 19701 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 19702 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 19724 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 19732 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 19735 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 19735 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 19807 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 19808 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 19818 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=78.0146484375, floorSegmentMB=2.0732421875, forceMergeDeletesPctAllowed=7.3826523237640815, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.28749322901482977
[junit4] 2> 20003 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b771b66d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c406934; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 20004 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 20004 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2f30ef3[collection1] main
[junit4] 2> 20005 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 20007 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 20007 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 20030 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 20030 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 20031 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 20032 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 20033 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 20033 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 20034 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 20038 INFO (searcherExecutor-19-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2f30ef3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 20052 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 20053 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 20053 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 20053 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1503954247884996608
[junit4] 2> 20053 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1 ms to seed version buckets with highest version 1503954247884996608
[junit4] 2> 20055 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 20058 INFO (coreLoadExecutor-18-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 20060 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:51887/hun/d collection:control_collection shard:shard1
[junit4] 2> 20068 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 20079 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 20082 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 20084 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 20087 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 20087 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 20088 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:51887/hun/d/collection1/
[junit4] 2> 20088 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 20090 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 20090 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:51887/hun/d/collection1/ has no replicas
[junit4] 2> 20090 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:51887/hun/d/collection1/ shard1
[junit4] 2> 20094 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 20096 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 20109 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 20114 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:51887/hun/d",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 20219 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 20224 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 20261 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:51887/hun/d/collection1/ and leader is http://127.0.0.1:51887/hun/d/collection1/
[junit4] 2> 20262 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51887/hun/d
[junit4] 2> 20262 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 20262 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 20262 INFO (coreZkRegister-12-thread-1-processing-n:127.0.0.1:51887_hun%2Fd x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51887_hun%2Fd c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 20265 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 20268 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51887/hun/d",
[junit4] 2> "node_name":"127.0.0.1:51887_hun%2Fd",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 20268 INFO (OverseerStateUpdate-93997140197834755-127.0.0.1:51887_hun%2Fd-n_0000000000) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:51887/hun/d",
[junit4] 2> "node_name":"127.0.0.1:51887_hun%2Fd",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 20378 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 20387 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 20435 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 20438 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 20443 INFO (zkCallback-8-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e4695d9 name:ZooKeeperConnection Watcher:127.0.0.1:43352/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 20443 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 20444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 20444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 20458 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 20907 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores/collection1
[junit4] 2> 20915 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001
[junit4] 2> 20926 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 20936 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5acdaaad{/hun/d,null,AVAILABLE}
[junit4] 2> 20937 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.ServerConnector Started ServerConnector@1ce88948{HTTP/1.1}{127.0.0.1:48078}
[junit4] 2> 20937 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.e.j.s.Server Started @24012ms
[junit4] 2> 20938 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:45475/hdfs__localhost_45475__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/hun/d, hostPort=48078, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores}
[junit4] 2> 20938 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 20938 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/'
[junit4] 2> 20984 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/solr.xml
[junit4] 2> 21004 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores
[junit4] 2> 21004 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoreContainer New CoreContainer 711893395
[junit4] 2> 21005 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/]
[junit4] 2> 21005 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/lib
[junit4] 2> 21005 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/lib).
[junit4] 2> 21051 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 21052 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 21053 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 21053 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 21053 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43352/solr
[junit4] 2> 21054 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 21054 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 21101 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 21118 INFO (zkCallback-10-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5bc4b88 name:ZooKeeperConnection Watcher:127.0.0.1:43352 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21123 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 21124 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 21159 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 21183 INFO (zkCallback-11-thread-1-processing-n:127.0.0.1:48078_hun%2Fd) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39f7d654 name:ZooKeeperConnection Watcher:127.0.0.1:43352/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 21183 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 21209 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 22217 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48078_hun%2Fd
[junit4] 2> 22218 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48078_hun%2Fd
[junit4] 2> 22225 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 22229 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 22229 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 22230 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores
[junit4] 2> 22233 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 22234 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_79C93828E5BF5909-001/shard-1-001/cores/collection1/
[junit4] 2> 22234 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 22263 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 22272 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[79C93828E5BF5909]) [n:127.0.0.1:48078_hun%2Fd ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 22272 INFO (coreLoadExecutor-29-thread-1-processing-n:127.0.0.1:48078_hun%2Fd) [n:127.0.0.1:48078_hun%2Fd c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 22272 INFO (coreLoadExecutor-29-thread-1-processing-n:127.0.0.1:48078_hun%2Fd) [n:127.0.0.1:48078_hun%2Fd c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 22274 INFO (zkCallback-6-thread-1-processing-n:127.0.0.1:51887_hun%2Fd) [n:127.0.0.1:51887_hun%2Fd ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 22279 INFO (coreLoadExecutor-29-thread-1-processing-n:127.0.0.1:48078_hun%2Fd) [n:127.0.0.1:48078_hun%2Fd c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 22280 INFO (OverseerSta
[...truncated too long message...]
O (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=33538679
[junit4] 2> 3842432 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@10992e2
[junit4] 2> 3842432 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=12,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=6,cumulative_deletesById=0,cumulative_deletesByQuery=2,cumulative_errors=0}
[junit4] 2> 3842433 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
[junit4] 2> 3842433 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 3842433 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
[junit4] 2> 3842433 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
[junit4] 2> 3842433 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 3842434 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001/init-core-data-001/index;done=false>>]
[junit4] 2> 3842434 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001/init-core-data-001/index
[junit4] 2> 3842434 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001/init-core-data-001;done=false>>]
[junit4] 2> 3842434 INFO (SUITE-TestSearcherReuse-seed#[79C93828E5BF5909]-worker) [ x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001/init-core-data-001
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestSearcherReuse_79C93828E5BF5909-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sv, timezone=Pacific/Midway
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=1,free=326368832,total=521142272
[junit4] 2> NOTE: All tests run in this JVM: [TestFoldingMultitermQuery, TestCustomDocTransformer, ActionThrottleTest, TestDistributedGrouping, JsonLoaderTest, DateRangeFieldTest, TestSolrQueryParserDefaultOperatorResource, TestStressUserVersions, ConvertedLegacyTest, TestValueSourceCache, OpenCloseCoreStressTest, TestFastLRUCache, FieldAnalysisRequestHandlerTest, TestMiniSolrCloudClusterSSL, AddBlockUpdateTest, BlockDirectoryTest, AlternateDirectoryTest, TestFastWriter, ZkCLITest, ZkControllerTest, TestManagedSchemaFieldTypeResource, TestComponentsName, TestFieldSortValues, OverseerStatusTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, FileUtilsTest, ShardRoutingCustomTest, TestRTGBase, TestCharFilters, TestJsonRequest, MergeStrategyTest, SpellingQueryConverterTest, SpellPossibilityIteratorTest, DocValuesMultiTest, TestMaxScoreQueryParser, DeleteReplicaTest, DistanceUnitsTest, DeleteShardTest, TestCursorMarkWithoutUniqueKey, DocumentBuilderTest, TestWriterPerf, AnalysisAfterCoreReloadTest, OverriddenZkACLAndCredentialsProvidersTest, SpellCheckComponentTest, SuggesterTSTTest, CollectionsAPIAsyncDistributedZkTest, JavabinLoaderTest, RuleEngineTest, LukeRequestHandlerTest, PreAnalyzedFieldTest, ChaosMonkeySafeLeaderTest, ShardRoutingTest, TestFiltering, TestBulkSchemaAPI, SolrPluginUtilsTest, TestReplicationHandlerBackup, DistributedDebugComponentTest, AtomicUpdatesTest, AsyncMigrateRouteKeyTest, CacheHeaderTest, TestTolerantSearch, UUIDUpdateProcessorFallbackTest, TestIndexSearcher, SolrXmlInZkTest, TestLRUStatsCache, TestIntervalFaceting, ResourceLoaderTest, EchoParamsTest, TestClusterStateMutator, TestDistributedStatsComponentCardinality, DocumentAnalysisRequestHandlerTest, ScriptEngineTest, SystemInfoHandlerTest, TestSuggestSpellingConverter, DistributedQueryComponentOptimizationTest, CloudMLTQParserTest, TestMiniSolrCloudCluster, ZkSolrClientTest, SolrCloudExampleTest, TestInitParams, TestManagedSchemaFieldResource, HdfsBasicDistributedZk2Test, TestOmitPositions, CollectionsAPIDistributedZkTest, DistributedTermsComponentTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, AutoCommitTest, TestFaceting, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestJoin, TestReload, TestStressVersions, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, StatsComponentTest, SolrCmdDistributorTest, PeerSyncTest, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, TestBadConfig, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, SolrIndexSplitterTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, SuggesterTest, TestStressLucene, TestTrie, SpatialFilterTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, XmlUpdateRequestHandlerTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, RequiredFieldsTest, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, ReturnFieldsTest, JSONWriterTest, MBeansHandlerTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, SearchHandlerTest, TestLFUCache, TestSystemIdResolver, PrimUtilsTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, SliceStateTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, CursorPagingTest, DistributedIntervalFacetingTest, CleanupOldIndexTest, ConnectionManagerTest, CustomCollectionTest, DistribDocExpirationUpdateProcessorTest, MultiThreadedOCPTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCollectionAPI, TestCryptoKeys, TestDownShardTolerantSearch, TestRandomRequestDistribution, TestRebalanceLeaders, TestRequestStatusCollectionAPI, TestShortCircuitedRequests, VMParamsZkACLAndCredentialsProvidersTest, HdfsChaosMonkeySafeLeaderTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest, HdfsThreadLeakTest, HdfsUnloadDistributedZkTest, StressHdfsTest, TestSearcherReuse]
[junit4] Completed [481/508] on J1 in 0.71s, 1 test, 1 failure <<< FAILURES!
[...truncated 92 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:512: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 508 suites, 2006 tests, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 169 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure