You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/06/15 18:13:36 UTC
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 712 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/712/
3 tests failed.
REGRESSION: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
Unable to restart (#3): CloudJettyRunner [url=http://127.0.0.1:51233/collection1]
Stack Trace:
java.lang.AssertionError: Unable to restart (#3): CloudJettyRunner [url=http://127.0.0.1:51233/collection1]
at __randomizedtesting.SeedInfo.seed([1F34ED704AEF5E07:9760D2AAE41333FF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:53)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=27341, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=27341, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:49624: collection already exists: awholynewstresscollection_collection2_4
at __randomizedtesting.SeedInfo.seed([1F34ED704AEF5E07]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1570)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1591)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=27041, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=27041, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59389: Could not find collection : awholynewstresscollection_collection4_1
at __randomizedtesting.SeedInfo.seed([1F34ED704AEF5E07]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10798 lines...]
[junit4] Suite: org.apache.solr.cloud.RollingRestartTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/init-core-data-001
[junit4] 2> 1648068 INFO (SUITE-RollingRestartTest-seed#[1F34ED704AEF5E07]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1648068 INFO (SUITE-RollingRestartTest-seed#[1F34ED704AEF5E07]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1648071 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1648071 INFO (Thread-7351) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1648071 INFO (Thread-7351) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1648171 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkTestServer start zk server on port:36878
[junit4] 2> 1648183 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1648185 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1648187 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1648189 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1648190 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1648192 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1648193 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1648195 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1648196 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1648198 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1648199 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1648538 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1
[junit4] 2> 1648540 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 1648543 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4722754c{/,null,AVAILABLE}
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.ServerConnector Started ServerConnector@21ef0578{HTTP/1.1}{127.0.0.1:35362}
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server Started @1652055ms
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/tempDir-001/control/data, hostContext=/, hostPort=35362, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores}
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 1648544 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/'
[junit4] 2> 1648559 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/solr.xml
[junit4] 2> 1648565 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores
[junit4] 2> 1648566 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer New CoreContainer 783154129
[junit4] 2> 1648566 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/]
[junit4] 2> 1648566 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/lib
[junit4] 2> 1648566 WARN (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/lib).
[junit4] 2> 1648573 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1648574 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36878/solr
[junit4] 2> 1648575 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1648607 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35362_
[junit4] 2> 1648610 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1648610 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94003654443401219-127.0.0.1:35362_-n_0000000000
[junit4] 2> 1648611 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35362_
[junit4] 2> 1648612 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer Overseer (id=94003654443401219-127.0.0.1:35362_-n_0000000000) starting
[junit4] 2> 1648620 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1648633 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1648634 INFO (OverseerCollectionProcessor-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 1648653 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1648653 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1648654 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores
[junit4] 2> 1648655 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1648655 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/
[junit4] 2> 1648655 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1648670 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1648670 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1648670 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1648677 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1648677 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1648678 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:35362_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1648678 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1648681 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1648681 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 1648681 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 1649671 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1649671 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 1649671 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1649672 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/'
[junit4] 2> 1649686 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1649692 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1649695 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1649702 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1649703 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1649708 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1649792 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1649797 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1649798 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1649805 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1649807 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1649809 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1649810 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1649810 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1649810 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1649810 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1649811 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1649811 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1649811 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1649817 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1649817 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@10adf93f
[junit4] 2> 1649818 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data
[junit4] 2> 1649818 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index/
[junit4] 2> 1649819 WARN (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1649819 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index
[junit4] 2> 1649819 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1649831 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1649831 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1649831 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/
[junit4] 2> 1649834 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1649834 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1649835 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1649836 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1649837 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649838 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649839 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649840 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1649843 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1649843 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1649844 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1649844 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1649845 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1649845 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1649845 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1649846 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1649846 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1649846 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@575e7f1d[collection1] main
[junit4] 2> 1649847 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1649848 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1649848 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1649848 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1649849 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1649850 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504058472957739008
[junit4] 2> 1649852 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2 ms to seed version buckets with highest version 1504058472957739008
[junit4] 2> 1649852 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1649853 INFO (searcherExecutor-3826-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@575e7f1d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1649853 INFO (coreLoadExecutor-3825-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1649857 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:35362 collection:control_collection shard:shard1
[junit4] 2> 1649861 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94003654443401219-core_node1-n_0000000000
[junit4] 2> 1649862 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 1649863 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1649863 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1649864 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1649864 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1649865 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35362/collection1/
[junit4] 2> 1649865 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1649866 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:35362/collection1/ has no replicas
[junit4] 2> 1649866 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35362/collection1/ shard1
[junit4] 2> 1649873 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1649874 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1650019 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:35362/collection1/ and leader is http://127.0.0.1:35362/collection1/
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35362
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 1650020 INFO (coreZkRegister-3819-thread-1-processing-n:127.0.0.1:35362_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:35362_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1650021 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1650022 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1650022 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:35362",
[junit4] 2> "node_name":"127.0.0.1:35362_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1650196 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1650197 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 1650199 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1650201 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 1650201 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 1650303 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 1650502 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1
[junit4] 2> 1650503 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001
[junit4] 2> 1650504 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 1650505 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@487cf7f8{/,null,AVAILABLE}
[junit4] 2> 1650506 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3b67a466{HTTP/1.1}{127.0.0.1:42913}
[junit4] 2> 1650506 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.e.j.s.Server Started @1654018ms
[junit4] 2> 1650506 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=42913, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores}
[junit4] 2> 1650507 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 1650507 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/'
[junit4] 2> 1650529 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/solr.xml
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer New CoreContainer 673817990
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/]
[junit4] 2> 1650534 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/lib
[junit4] 2> 1650534 WARN (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/lib).
[junit4] 2> 1650548 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 1650549 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36878/solr
[junit4] 2> 1650550 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1651564 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42913_
[junit4] 2> 1651568 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1651568 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94003654443401223-127.0.0.1:42913_-n_0000000001
[junit4] 2> 1651569 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94003654443401219-127.0.0.1:35362_-n_0000000000 to know if I could be the leader
[junit4] 2> 1651569 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1651570 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1651570 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores
[junit4] 2> 1651571 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 1651571 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/
[junit4] 2> 1651571 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 1651573 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 1651573 INFO (TEST-RollingRestartTest.test-seed#[1F34ED704AEF5E07]) [n:127.0.0.1:42913_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1651573 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 1651573 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 1651574 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1651574 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for external collection collection1
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42913",
[junit4] 2> "node_name":"127.0.0.1:42913_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42913",
[junit4] 2> "node_name":"127.0.0.1:42913_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 1651575 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 1651576 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 1651677 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1652576 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 1652577 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 1652577 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 1652578 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/'
[junit4] 2> 1652592 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 1652600 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 1652603 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1652620 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1652622 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1652628 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 1652717 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1652724 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 1652726 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 1652733 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1652736 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 1652738 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1652739 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1652739 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1652739 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1652740 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 1652740 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 1652740 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1652741 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
[junit4] 2> 1652741 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 1652741 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@10adf93f
[junit4] 2> 1652742 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data
[junit4] 2> 1652743 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1652743 WARN (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1652743 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1652744 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1652755 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1652756 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1652756 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/
[junit4] 2> 1652761 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1652761 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1652761 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1652762 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1652763 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1652763 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1652765 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652767 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652768 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652769 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 1652775 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 1652776 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1652785 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1652786 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1652787 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 1652787 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 1652787 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1652788 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.RollingRestartTest_1F34ED704AEF5E07-001/shard-1-001/cores/collection1/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1652788 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 1652789 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@5b368bf2[collection1] main
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 1652790 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 1652791 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1652792 INFO (searcherExecutor-3837-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5b368bf2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1652792 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 1652793 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 1652793 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 1652793 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504058476043698176
[junit4] 2> 1652796 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1504058476043698176
[junit4] 2> 1652796 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 1652796 INFO (coreLoadExecutor-3836-thread-1-processing-n:127.0.0.1:42913_) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 1652797 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:42913 collection:collection1 shard:shard2
[junit4] 2> 1652801 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/collection1/leader_elect/shard2/election/94003654443401223-core_node1-n_0000000000
[junit4] 2> 1652802 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard2
[junit4] 2> 1652803 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1652804 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1652804 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 1652804 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1652805 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42913/collection1/
[junit4] 2> 1652805 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 1
[junit4] 2> 1652805 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1652806 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42913/collection1/ has no replicas
[junit4] 2> 1652806 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42913/collection1/ shard2
[junit4] 2> 1652809 INFO (zkCallback-1000-thread-1-processing-n:127.0.0.1:35362_) [n:127.0.0.1:35362_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1652810 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:42913",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 1652811 INFO (OverseerStateUpdate-94003654443401219-127.0.0.1:35362_-n_0000000000) [n:127.0.0.1:35362_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 2
[junit4] 2> 1652860 INFO (coreZkRegister-3831-thread-1-processing-n:127.0.0.1:42913_ x:collection1 s:shard2 c:collection1 r:core_node1) [n:127.0.0.1:42913_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:42913/collection1/ and leader is http://127.
[...truncated too long message...]
] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4289190 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1F34ED704AEF5E07]-worker) [n:127.0.0.1:56511_ c:addReplicaColl s:shard1 r:core_node5 x:addReplicaColl_shard1_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 15, 2015 12:09:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=BlockTreeOrds(blocksize=128), range_facet_l_dv=PostingsFormat(name=LuceneFixedGap), _version_=BlockTreeOrds(blocksize=128), multiDefault=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), intDefault=BlockTreeOrds(blocksize=128), a_i1=PostingsFormat(name=Asserting), id=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=PostingsFormat(name=Asserting), text=PostingsFormat(name=MockRandom), range_facet_l=PostingsFormat(name=Asserting), timestamp=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=zh_TW, timezone=Etc/Greenwich
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=43731328,total=529006592
[junit4] 2> NOTE: All tests run in this JVM: [TestDistributedStatsComponentCardinality, RAMDirectoryFactoryTest, TestConfigOverlay, SpellPossibilityIteratorTest, TestLRUCache, TestSerializedLuceneMatchVersion, OverseerRolesTest, TestTrieFacet, AnalyticsQueryTest, InfoHandlerTest, TestAtomicUpdateErrorCases, ConcurrentDeleteAndCreateCollectionTest, TestRandomMergePolicy, TestImplicitCoreProperties, TestFieldCollectionResource, TestManagedResource, TestSolrDeletionPolicy2, NoCacheHeaderTest, TestComponentsName, TestFieldSortValues, TestHashPartitioner, OutOfBoxZkACLAndCredentialsProvidersTest, DocumentAnalysisRequestHandlerTest, SpellingQueryConverterTest, TestCoreDiscovery, ZkControllerTest, TestFuzzyAnalyzedSuggestions, TestIndexSearcher, DistributedExpandComponentTest, OpenCloseCoreStressTest, TestAuthorizationFramework, ResourceLoaderTest, IndexSchemaRuntimeFieldTest, RequiredFieldsTest, ShardRoutingTest, TestCollationFieldDocValues, TestManagedSchemaDynamicFieldResource, ScriptEngineTest, TestStressUserVersions, CopyFieldTest, SuggesterTSTTest, JSONWriterTest, TestSolrCoreProperties, TestLMJelinekMercerSimilarityFactory, TestSolrConfigHandlerCloud, HdfsNNFailoverTest, TestSchemaResource, TestManagedSchema, TestRTGBase, CacheHeaderTest, DistanceFunctionTest, HighlighterMaxOffsetTest, CollectionReloadTest, ChangedSchemaMergeTest, ConvertedLegacyTest, FileUtilsTest, TestExceedMaxTermLength, SolrCloudExampleTest, DistributedVersionInfoTest, TestLMDirichletSimilarityFactory, TestRandomRequestDistribution, TestReplicaProperties, CoreAdminRequestStatusTest, AddSchemaFieldsUpdateProcessorFactoryTest, AnalyticsMergeStrategyTest, RequestLoggingTest, TestWriterPerf, TestFastLRUCache, TestSearchPerf, HdfsDirectoryTest, TestShardHandlerFactory, DisMaxRequestHandlerTest, VMParamsZkACLAndCredentialsProvidersTest, PreAnalyzedFieldTest, ShowFileRequestHandlerTest, TestSchemaSimilarityResource, WordBreakSolrSpellCheckerTest, CloudExitableDirectoryReaderTest, TestNamedUpdateProcessors, RollingRestartTest, AutoCommitTest, TestDistributedGrouping, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestStressReorder, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, HighlighterTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, TestStressLucene, SpatialFilterTest, TestCSVLoader, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, LukeRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, TestOmitPositions, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, SolrPluginUtilsTest, TestCollationField, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, PingRequestHandlerTest, TestLFUCache, TestHighlightDedupGrouping, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CollectionStateFormat2Test, DistribCursorPagingTest, LeaderInitiatedRecoveryOnCommitTest, MigrateRouteKeyTest, RemoteQueryErrorTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, TestAuthenticationFramework, TestCloudInspectUtil, TestCloudPivotFacet, TestCollectionAPI, TestDistribDocBasedVersion, TestLeaderElectionZkExpiry, TestRequestStatusCollectionAPI, TestShortCircuitedRequests, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [510/510] on J1 in 1111.57s, 1 test, 1 error <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 510 suites, 2009 tests, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 206 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 717 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/717/
3 tests failed.
REGRESSION: org.apache.solr.search.TestSearcherReuse.test
Error Message:
expected same:<Searcher@600ad70c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}> was not:<Searcher@5de2c8cf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}>
Stack Trace:
java.lang.AssertionError: expected same:<Searcher@600ad70c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}> was not:<Searcher@5de2c8cf[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C3) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C1)))}>
at __randomizedtesting.SeedInfo.seed([A7CE6FE98D323E8F:2F9A503323CE5377]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotSame(Assert.java:641)
at org.junit.Assert.assertSame(Assert.java:580)
at org.junit.Assert.assertSame(Assert.java:593)
at org.apache.solr.search.TestSearcherReuse.assertSearcherHasNotChanged(TestSearcherReuse.java:247)
at org.apache.solr.search.TestSearcherReuse.test(TestSearcherReuse.java:117)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=1910, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1910, name=collection2, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:47592, http://127.0.0.1:48781, http://127.0.0.1:52380, http://127.0.0.1:53657, http://127.0.0.1:35017]
at __randomizedtesting.SeedInfo.seed([A7CE6FE98D323E8F]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:896)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:47592, http://127.0.0.1:48781, http://127.0.0.1:52380, http://127.0.0.1:53657, http://127.0.0.1:35017]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47592: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
... 5 more
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=8172, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=8172, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:42169/ntce/jk: Could not find collection : awholynewstresscollection_collection3_1
at __randomizedtesting.SeedInfo.seed([A7CE6FE98D323E8F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
Build Log:
[...truncated 10018 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/init-core-data-001
[junit4] 2> 149200 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A7CE6FE98D323E8F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 149200 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A7CE6FE98D323E8F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 149207 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 149215 INFO (Thread-988) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 149215 INFO (Thread-988) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 149308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkTestServer start zk server on port:57511
[junit4] 2> 149308 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 149313 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149326 INFO (zkCallback-113-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4c6697c8 name:ZooKeeperConnection Watcher:127.0.0.1:57511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 149327 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 149330 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 149338 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149339 INFO (zkCallback-114-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@45ed3aec name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 149341 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 149344 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 149347 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 149349 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 149351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 149351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 149356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 149356 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 149359 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 149359 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 149361 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 149362 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 149363 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 149364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 149365 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 149366 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 149368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 149368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 149370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 149370 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 149372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 149372 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 149374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 149374 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 149376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 149376 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 149732 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1
[junit4] 2> 149740 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 149826 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f4046fd{/,null,AVAILABLE}
[junit4] 2> 149833 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5778e4ae{HTTP/1.1}{127.0.0.1:48781}
[junit4] 2> 149834 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server Started @153315ms
[junit4] 2> 149835 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/tempDir-001/control/data, hostContext=/, hostPort=48781, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores}
[junit4] 2> 149835 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 149838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/'
[junit4] 2> 149853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/solr.xml
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1406093189
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/]
[junit4] 2> 149863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/lib
[junit4] 2> 149863 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/lib).
[junit4] 2> 149871 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 149874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 149874 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57511/solr
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 149875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 149883 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149883 INFO (zkCallback-116-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@519d3021 name:ZooKeeperConnection Watcher:127.0.0.1:57511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149884 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149884 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 149890 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 149893 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@100e4ab2 name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149893 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 149894 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 149896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 149898 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 149899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 149901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 149902 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 149903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 149904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 149905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48781_
[junit4] 2> 149906 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:48781_
[junit4] 2> 149907 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 149908 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 149909 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 149909 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94030712546983939-127.0.0.1:48781_-n_0000000000
[junit4] 2> 149910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:48781_
[junit4] 2> 149910 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 149911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer Overseer (id=94030712546983939-127.0.0.1:48781_-n_0000000000) starting
[junit4] 2> 149914 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 149919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 149920 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 149922 INFO (OverseerCollectionProcessor-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 149931 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 149933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 149933 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 149934 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores
[junit4] 2> 149935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 149935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/
[junit4] 2> 149935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 149936 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 149936 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 149938 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 149938 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 149938 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:48781_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 149939 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 149939 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 149940 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 149940 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 149942 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149943 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 149944 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 149944 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 149944 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 149945 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 149945 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 149948 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 149949 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/'
[junit4] 2> 149973 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 149979 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 149983 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 149992 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 149993 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 149999 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 150123 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 150132 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 150133 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 150151 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 150153 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 150155 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 150156 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 150156 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 150156 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 150157 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 150157 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 150157 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 150157 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 150158 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 150158 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cb10baf
[junit4] 2> 150158 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data
[junit4] 2> 150159 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/index/
[junit4] 2> 150159 WARN (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 150160 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/index
[junit4] 2> 150161 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=966355182, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 150205 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f307b86),segFN=segments_1,generation=1}
[junit4] 2> 150205 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 150218 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 150219 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 150220 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 150220 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 150220 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 150222 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150223 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150224 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150224 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/
[junit4] 2> 150225 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 150236 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 150246 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 150246 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 150253 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 150253 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 150254 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 150254 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 150254 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=28.591796875, floorSegmentMB=0.76953125, forceMergeDeletesPctAllowed=8.925424591396729, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5246243728212946
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(MMapDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/index-MMapDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f307b86),segFN=segments_1,generation=1}
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@12b5816f[collection1] main
[junit4] 2> 150260 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 150262 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 150263 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 150264 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504491401844359168
[junit4] 2> 150266 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2 ms to seed version buckets with highest version 1504491401844359168
[junit4] 2> 150266 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 150267 INFO (searcherExecutor-319-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@12b5816f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 150268 INFO (coreLoadExecutor-318-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 150284 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:48781 collection:control_collection shard:shard1
[junit4] 2> 150289 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 150295 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94030712546983939-core_node1-n_0000000000
[junit4] 2> 150296 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 150297 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150297 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 150297 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:48781/collection1/
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:48781/collection1/ has no replicas
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:48781/collection1/ shard1
[junit4] 2> 150298 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 150299 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 150302 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150303 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 150405 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150406 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 150440 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:48781/collection1/ and leader is http://127.0.0.1:48781/collection1/
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48781
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 150453 INFO (coreZkRegister-312-thread-1-processing-n:127.0.0.1:48781_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:48781_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 150455 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150456 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 150457 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:48781",
[junit4] 2> "node_name":"127.0.0.1:48781_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 150464 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150473 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@631fb797 name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 150473 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 150477 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 150478 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 150478 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 150489 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150492 INFO (zkCallback-120-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@af2102d name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150493 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150493 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 150495 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 150498 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 150498 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 150501 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150509 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150512 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 150512 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 150614 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 150615 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150615 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150617 INFO (zkCallback-119-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 150620 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 150895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1
[junit4] 2> 150896 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001
[junit4] 2> 150899 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 150904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@423f58f5{/,null,AVAILABLE}
[junit4] 2> 150904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@7feafcfd{HTTP/1.1}{127.0.0.1:53657}
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.e.j.s.Server Started @154385ms
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=53657, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores}
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 150905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/'
[junit4] 2> 150929 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/solr.xml
[junit4] 2> 150935 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores
[junit4] 2> 150936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer New CoreContainer 930125312
[junit4] 2> 150936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/]
[junit4] 2> 150936 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/lib
[junit4] 2> 150936 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/lib).
[junit4] 2> 150948 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 150950 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57511/solr
[junit4] 2> 150951 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 150951 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 150952 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150969 INFO (zkCallback-122-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e477909 name:ZooKeeperConnection Watcher:127.0.0.1:57511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150972 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150973 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 150982 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 150983 INFO (zkCallback-123-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b316139 name:ZooKeeperConnection Watcher:127.0.0.1:57511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 150983 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 150987 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 151996 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53657_
[junit4] 2> 151997 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53657_
[junit4] 2> 152005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 152005 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94030712546983943-127.0.0.1:53657_-n_0000000001
[junit4] 2> 152006 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94030712546983939-127.0.0.1:48781_-n_0000000000 to know if I could be the leader
[junit4] 2> 152007 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 152007 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 152008 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores
[junit4] 2> 152009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 152009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A7CE6FE98D323E8F-001/shard-1-001/cores/collection1/
[junit4] 2> 152009 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 152016 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 152016 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 152026 INFO (zkCallback-117-thread-1-processing-n:127.0.0.1:48781_) [n:127.0.0.1:48781_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 152026 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController Registering watch for external collection collection1
[junit4] 2> 152026 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
[junit4] 2> 152026 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53657",
[junit4] 2> "node_name":"127.0.0.1:53657_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 4
[junit4] 2> 152033 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 152033 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:53657",
[junit4] 2> "node_name":"127.0.0.1:53657_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 152033 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
[junit4] 2> 152033 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 152036 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0
[junit4] 2> 152036 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 152037 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A7CE6FE98D323E8F]) [n:127.0.0.1:53657_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 152037 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 152136 INFO (OverseerStateUpdate-94030712546983939-127.0.0.1:48781_-n_0000000000) [n:127.0.0.1:48781_ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 152137 INFO (zkCallback-123-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 152137 INFO (zkCallback-123-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 1
[junit4] 2> 153037 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 153037 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 153038 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 153038 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 153039 INFO (coreLoadExecutor-329-thread-1-processing-n:127.0.0.1:53657_) [n:127.0.0.1:53657_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 153039 INFO (coreLoadExecut
[...truncated too long message...]
DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
[junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
[junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 1444105 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[A7CE6FE98D323E8F]-worker) [n:127.0.0.1:37681_ntce%2Fjk c:addReplicaColl s:shard1 r:core_node4 x:addReplicaColl_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 20, 2015 6:28:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=FST50, range_facet_l_dv=Lucene50(blocksize=128), _version_=FST50, multiDefault=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=LuceneFixedGap), intDefault=FST50, a_i1=PostingsFormat(name=LuceneFixedGap), id=Lucene50(blocksize=128), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), text=Lucene50(blocksize=128), range_facet_l=PostingsFormat(name=LuceneFixedGap), timestamp=PostingsFormat(name=LuceneFixedGap)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=es_CL, timezone=America/Cayenne
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=208105816,total=534249472
[junit4] 2> NOTE: All tests run in this JVM: [AutoCommitTest, TestCursorMarkWithoutUniqueKey, TestBinaryResponseWriter, SolrCoreCheckLockOnStartupTest, ActionThrottleTest, SpellCheckCollatorTest, TestDefaultSimilarityFactory, PrimUtilsTest, QueryParsingTest, TestDownShardTolerantSearch, SolrXmlInZkTest, RegexBoostProcessorTest, JavabinLoaderTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestSolrQueryParser, OverseerRolesTest, QueryEqualityTest, TestSolrDynamicMBean, TestZkChroot, HdfsDirectoryTest, TestCopyFieldCollectionResource, OverseerTest, TestInitQParser, TestSolrQueryParserDefaultOperatorResource, SearchHandlerTest, DocValuesTest, ResponseLogComponentTest, DirectUpdateHandlerTest, TestDistribDocBasedVersion, TestExceedMaxTermLength, CleanupOldIndexTest, TestAuthorizationFramework, DistributedFacetPivotSmallTest, AnalyticsMergeStrategyTest, TestReplicationHandlerBackup, TestReload, TestSchemaNameResource, SuggesterTest, TestShortCircuitedRequests, TestSystemIdResolver, OpenExchangeRatesOrgProviderTest, TestSolrQueryParserResource, DOMUtilTest, NotRequiredUniqueKeyTest, TestCSVResponseWriter, DistribCursorPagingTest, OutOfBoxZkACLAndCredentialsProvidersTest, LeaderElectionTest, DeleteLastCustomShardedReplicaTest, DistributedQueueTest, PolyFieldTest, TestRebalanceLeaders, SoftAutoCommitTest, VMParamsZkACLAndCredentialsProvidersTest, TestUtils, OverriddenZkACLAndCredentialsProvidersTest, TestSolr4Spatial2, CustomCollectionTest, TestStressRecovery, TestXIncludeConfig, DistributedSuggestComponentTest, PathHierarchyTokenizerFactoryTest, TestNoOpRegenerator, TestRawResponseWriter, BadIndexSchemaTest, TestMaxScoreQueryParser, TestSearcherReuse, SolrIndexSplitterTest, TestMiniSolrCloudCluster, TestLuceneMatchVersion, SampleTest, FullSolrCloudDistribCmdsTest, UnloadDistributedZkTest, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [218/512] on J2 in 358.22s, 1 test, 1 error <<< FAILURES!
[...truncated 964 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 512 suites, 2015 tests, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 177 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 716 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/716/
2 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=16497, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16497, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
at __randomizedtesting.SeedInfo.seed([E7088F6DFBD3183F]:0)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:896)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1572)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:886)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38217/uxupv: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
... 7 more
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=8693, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=8693, name=collection4, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:60005: Could not find collection : awholynewstresscollection_collection4_0
at __randomizedtesting.SeedInfo.seed([E7088F6DFBD3183F]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
Build Log:
[...truncated 10806 lines...]
[junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/init-core-data-001
[junit4] 2> 933962 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 933962 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 1> Formatting using clusterid: testClusterID
[junit4] 2> 934004 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
[junit4] 2> 934026 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 934031 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 934043 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_35902_hdfs____gyekub/webapp
[junit4] 2> 934149 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 934508 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35902
[junit4] 2> 934622 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 934624 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 934640 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_47695_datanode____449m8m/webapp
[junit4] 2> 934740 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 935107 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:47695
[junit4] 2> 935186 WARN (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
[junit4] 2> 935188 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log jetty-6.1.26
[junit4] 2> 935226 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_53978_datanode____.4ts9st/webapp
[junit4] 2> 935315 INFO (IPC Server handler 3 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-b0b9e55f-383d-46e5-8b5c-03f2431dafb6 node DatanodeRegistration(127.0.0.1, datanodeUuid=42f45d32-9bfd-4dc7-972e-7eb1e18ec80c, infoPort=47695, ipcPort=38522, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 935315 INFO (IPC Server handler 3 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-e7de499e-f237-4c46-8a46-2d987e5f524e node DatanodeRegistration(127.0.0.1, datanodeUuid=42f45d32-9bfd-4dc7-972e-7eb1e18ec80c, infoPort=47695, ipcPort=38522, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 935366 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
[junit4] 2> 935770 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [ ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53978
[junit4] 2> 935897 INFO (IPC Server handler 4 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-edfe2ceb-132c-47af-bc8a-bf72808443c9 node DatanodeRegistration(127.0.0.1, datanodeUuid=181437a4-8240-4b47-9a6d-cba07753b1f9, infoPort=53978, ipcPort=38807, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
[junit4] 2> 935898 INFO (IPC Server handler 4 on 39691) [ ] BlockStateChange BLOCK* processReport: from storage DS-e993263d-e9c8-4617-affd-8042c1d7aa84 node DatanodeRegistration(127.0.0.1, datanodeUuid=181437a4-8240-4b47-9a6d-cba07753b1f9, infoPort=53978, ipcPort=38807, storageInfo=lv=-56;cid=testClusterID;nsid=708323866;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
[junit4] 2> 935953 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 935953 INFO (Thread-3270) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 935953 INFO (Thread-3270) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 936053 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkTestServer start zk server on port:42582
[junit4] 2> 936054 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936054 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936057 INFO (zkCallback-766-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@638a3ab6 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936057 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936057 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936057 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 936060 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936062 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936062 INFO (zkCallback-767-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d96fc65 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936063 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936063 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936063 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 936065 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 936067 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 936068 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 936070 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 936070 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 936072 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 936073 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 936074 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936075 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936076 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 936076 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 936078 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 936078 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 936079 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 936080 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 936081 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 936082 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 936083 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 936083 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 936085 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 936085 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 936086 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 936087 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 936088 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 936088 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 936090 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936091 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936092 INFO (zkCallback-768-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ad08d52 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936092 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936094 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936094 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936103 INFO (zkCallback-769-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4047aa63 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936103 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 936106 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936107 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936118 INFO (zkCallback-770-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bb041c9 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936118 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936119 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936119 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 936119 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 936125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 936125 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
[junit4] 2> 936133 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 936133 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 936135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936135 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 936136 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 936136 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
[junit4] 2> 936137 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 936137 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
[junit4] 2> 936138 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 936139 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
[junit4] 2> 936140 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 936140 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 936141 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 936141 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 936142 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 936142 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 936144 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 936144 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
[junit4] 2> 936145 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 936145 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
[junit4] 2> 936436 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1
[junit4] 2> 936438 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 936440 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6085d6d{/,null,AVAILABLE}
[junit4] 2> 936444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@154da174{SSL-http/1.1}{127.0.0.1:50440}
[junit4] 2> 936444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server Started @939601ms
[junit4] 2> 936444 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:39691/hdfs__localhost_39691__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001_tempDir-002_control_data, hostContext=/, hostPort=50440, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores}
[junit4] 2> 936446 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 936446 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/'
[junit4] HEARTBEAT J0 PID(26478@lucene1-us-west): 2015-06-19T20:23:26, stalled for 300s at: TestDistributedSearch.test
[junit4] 2> 936460 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/solr.xml
[junit4] 2> 936465 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores
[junit4] 2> 936465 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer New CoreContainer 979576554
[junit4] 2> 936466 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/]
[junit4] 2> 936466 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/lib
[junit4] 2> 936466 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/lib).
[junit4] 2> 936473 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 936475 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 936476 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 936476 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 936476 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42582/solr
[junit4] 2> 936477 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 936477 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 936482 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936484 INFO (zkCallback-772-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@768ee744 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936485 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936485 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 936488 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 936489 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1debbac0 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 936489 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 936490 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 936491 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 936492 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 936494 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 936495 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 936498 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 936499 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 936500 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 936501 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50440_
[junit4] 2> 936501 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:50440_
[junit4] 2> 936502 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 936503 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 936505 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 936509 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94028379560280070-127.0.0.1:50440_-n_0000000000
[junit4] 2> 936510 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:50440_
[junit4] 2> 936510 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 936511 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer Overseer (id=94028379560280070-127.0.0.1:50440_-n_0000000000) starting
[junit4] 2> 936514 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 936518 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 936518 INFO (OverseerCollectionProcessor-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 936519 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 936519 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 936522 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 936522 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 936523 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores
[junit4] 2> 936524 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 936524 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/
[junit4] 2> 936524 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 936526 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
[junit4] 2> 936526 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [n:127.0.0.1:50440_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 936526 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 936526 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 936527 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 936527 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 936527 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 936528 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 936528 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 936528 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 936531 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 936532 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 937527 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 937527 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 937528 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 937528 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 937529 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 937529 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/'
[junit4] 2> 937542 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 937546 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 937549 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 937557 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 937558 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 937562 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 937653 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 937658 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 937659 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 937667 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 937669 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 937671 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 937671 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 937671 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 937672 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 937672 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 937672 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 937672 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:39691/solr_hdfs_home
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 937673 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@37e17ab
[junit4] 2> 937674 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 937719 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
[junit4] 2> 937719 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data
[junit4] 2> 937721 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index/
[junit4] 2> 937732 WARN (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
[junit4] 2> 937732 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 937748 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
[junit4] 2> 937748 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/index
[junit4] 2> 937749 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=166353292, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 937785 INFO (IPC Server handler 3 on 39691) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42076 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b0b9e55f-383d-46e5-8b5c-03f2431dafb6:NORMAL:127.0.0.1:33526|RBW], ReplicaUnderConstruction[[DISK]DS-edfe2ceb-132c-47af-bc8a-bf72808443c9:NORMAL:127.0.0.1:42076|RBW]]} size 0
[junit4] 2> 937790 INFO (IPC Server handler 5 on 39691) [ ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33526 is added to blk_1073741825_1001 size 71
[junit4] 2> 937793 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b6c5b335 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5873e64; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 937793 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 937811 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 937811 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 937811 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 937812 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 937813 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:39691/solr_hdfs_home/control_collection/core_node1/data/
[junit4] 2> 937814 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937815 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937816 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937817 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 937820 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 937820 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 937821 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
[junit4] 2> 937821 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
[junit4] 2> 937833 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 937833 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 937835 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=76.5771484375, floorSegmentMB=1.470703125, forceMergeDeletesPctAllowed=24.302973055038148, segmentsPerTier=48.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(HdfsDirectory@b6c5b335 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5873e64; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7e33941c[collection1] main
[junit4] 2> 937864 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 937865 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 937865 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 937865 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 937866 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 937866 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 937866 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 937867 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 937867 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 937867 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 937868 INFO (searcherExecutor-2296-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7e33941c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 937870 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 937870 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504454074973552640
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1 ms to seed version buckets with highest version 1504454074973552640
[junit4] 2> 937871 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 937873 INFO (coreLoadExecutor-2295-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 937874 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:50440 collection:control_collection shard:shard1
[junit4] 2> 937875 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 937878 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94028379560280070-core_node1-n_0000000000
[junit4] 2> 937879 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 937880 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 937880 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 937880 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 937880 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:50440/collection1/
[junit4] 2> 937880 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:50440/collection1/ has no replicas
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:50440/collection1/ shard1
[junit4] 2> 937881 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 937884 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 937884 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 937988 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 937990 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 938030 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 938031 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 938032 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@610a971a name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 938032 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 938032 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 938032 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 938035 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:50440/collection1/ and leader is https://127.0.0.1:50440/collection1/
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50440
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 938035 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 938035 INFO (coreZkRegister-2289-thread-1-processing-n:127.0.0.1:50440_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:50440_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 938035 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 938037 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 938037 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 938038 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 938038 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50440",
[junit4] 2> "node_name":"127.0.0.1:50440_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 938042 INFO (zkCallback-776-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c719a70 name:ZooKeeperConnection Watcher:127.0.0.1:42582/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 938042 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 938042 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 938049 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 938054 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 938055 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 938055 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938056 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 938065 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938071 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 938158 INFO (OverseerStateUpdate-94028379560280070-127.0.0.1:50440_-n_0000000000) [n:127.0.0.1:50440_ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 938159 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938159 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 938160 INFO (zkCallback-775-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 938162 INFO (zkCallback-773-thread-1-processing-n:127.0.0.1:50440_) [n:127.0.0.1:50440_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 938361 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/cores/collection1
[junit4] 2> 938362 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001
[junit4] 2> 938363 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 938365 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1aca0984{/,null,AVAILABLE}
[junit4] 2> 938368 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.ServerConnector Started ServerConnector@5c065822{SSL-http/1.1}{127.0.0.1:52260}
[junit4] 2> 938369 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.e.j.s.Server Started @941525ms
[junit4] 2> 938369 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:39691/hdfs__localhost_39691__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=52260, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/cores}
[junit4] 2> 938370 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 938370 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/'
[junit4] 2> 938384 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/solr.xml
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/cores
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer New CoreContainer 1035470588
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/]
[junit4] 2> 938389 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/lib
[junit4] 2> 938390 WARN (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_E7088F6DFBD3183F-001/shard-1-001/lib).
[junit4] 2> 938397 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 938399 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42582/solr
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 938401 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 938402 INFO (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[E7088F6DFBD3183F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 938403 INFO (zkCallback-778-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3eaf9e95 name:ZooKeeperConnection Watcher:127.0.0.1:42582 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 938404 I
[...truncated too long message...]
che.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > ... 7 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=16493, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
[junit4] > at __randomizedtesting.SeedInfo.seed([E7088F6DFBD3183F]:0)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:896)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:53032/uxupv, http://127.0.0.1:59222/uxupv, http://127.0.0.1:38217/uxupv, http://127.0.0.1:55026/uxupv, http://127.0.0.1:57926/uxupv]
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:893)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:38217/uxupv
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:572)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > ... 5 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:150)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:121)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:466)
[junit4] > ... 9 more
[junit4] 2> 2110201 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[E7088F6DFBD3183F]-worker) [n:127.0.0.1:59222_uxupv c:awholynewstresscollection_collection4_0 s:shard2 r:core_node16 x:awholynewstresscollection_collection4_0_shard2_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=PostingsFormat(name=Memory doPackFST= true), range_facet_l_dv=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=Memory doPackFST= true), multiDefault=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=Memory doPackFST= true), a_i1=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Asserting), range_facet_i_dv=PostingsFormat(name=MockRandom), text=FSTOrd50, range_facet_l=PostingsFormat(name=MockRandom), timestamp=PostingsFormat(name=MockRandom)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=DefaultSimilarity, locale=ar_IQ, timezone=America/Porto_Acre
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=1,free=104141880,total=534249472
[junit4] 2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, TestComplexPhraseQParserPlugin, HttpPartitionTest, CoreAdminHandlerTest, ClusterStateUpdateTest, ZkCLITest, TestNRTOpen, TestMacros, HighlighterMaxOffsetTest, BlockCacheTest, TestFieldTypeCollectionResource, TestLMDirichletSimilarityFactory, TestSolrCoreProperties, TestSortingResponseWriter, MigrateRouteKeyTest, TestOmitPositions, TestFieldSortValues, TestJsonRequest, TestConfigSets, TestCoreContainer, TestWriterPerf, IndexSchemaRuntimeFieldTest, NoCacheHeaderTest, TestLRUStatsCache, StatelessScriptUpdateProcessorFactoryTest, HdfsThreadLeakTest, ShowFileRequestHandlerTest, ParsingFieldUpdateProcessorsTest, SolrCmdDistributorTest, UUIDUpdateProcessorFallbackTest, BaseCdcrDistributedZkTest, TriLevelCompositeIdRoutingTest, TestOverriddenPrefixQueryForCustomFieldType, FieldMutatingUpdateProcessorTest, EchoParamsTest, ShardRoutingCustomTest, TestRTGBase, TestSearchPerf, SpellCheckComponentTest, HdfsRecoveryZkTest, TestFastLRUCache, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestAtomicUpdateErrorCases, TestCryptoKeys, TestSolrConfigHandlerConcurrent, RAMDirectoryFactoryTest, TestManagedSchema, TestRemoveLastDynamicCopyField, SolrPluginUtilsTest, DocumentAnalysisRequestHandlerTest, TestAnalyzedSuggestions, BufferStoreTest, TestDefaultStatsCache, TestManagedSchemaFieldTypeResource, TestReplicaProperties, TestFuzzyAnalyzedSuggestions, SystemInfoHandlerTest, HdfsWriteToMultipleCollectionsTest, ConvertedLegacyTest, TestCloudManagedSchema, TestDynamicLoading, SpatialFilterTest, AlternateDirectoryTest, HdfsChaosMonkeySafeLeaderTest, ScriptEngineTest, TestRandomMergePolicy, BadComponentTest, PreAnalyzedUpdateProcessorTest, TestManagedSchemaDynamicFieldResource, TestExpandComponent, CachingDirectoryFactoryTest, CopyFieldTest, TestCustomSort, TestLeaderElectionZkExpiry, TestTolerantSearch, TestRecoveryHdfs, TestCharFilters, CurrencyFieldOpenExchangeTest, RequestLoggingTest, TestEmbeddedSolrServerConstructors, ReturnFieldsTest, CacheHeaderTest, DistributedMLTComponentTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4] Completed [240/512] on J1 in 895.99s, 1 test, 1 error <<< FAILURES!
[...truncated 875 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 512 suites, 2015 tests, 2 errors, 20 ignored (10 assumptions)
Total time: 256 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 715 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/715/
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest
Error Message:
323 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 1) Thread[id=17732, name=searcherExecutor-4411-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=18458, name=qtp699233344-18458, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=16148, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120) 4) Thread[id=18243, name=coreZkRegister-3175-thread-18, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=18400, name=coreZkRegister-3349-thread-40-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=15977, name=searcherExecutor-3253-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=18300, name=coreZkRegister-3197-thread-29, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=18188, name=coreZkRegister-3186-thread-9-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=18359, name=coreZkRegister-3186-thread-25, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=18343, name=zkCallback-909-thread-29, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 11) Thread[id=19433, name=searcherExecutor-4568-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 12) Thread[id=19223, name=coreZkRegister-3197-thread-64, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=17638, name=searcherExecutor-4384-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=17680, name=searcherExecutor-4395-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 15) Thread[id=19356, name=coreZkRegister-3349-thread-68-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard5_replica1 s:shard5 c:awholynewstresscollection_collection2_4 r:core_node32, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 16) Thread[id=18186, name=coreZkRegister-3186-thread-7-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 17) Thread[id=16123, name=searcherExecutor-3366-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18) Thread[id=17514, name=qtp215754624-17514, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 19) Thread[id=19729, name=RecoveryThread-awholynewstresscollection_collection5_4_shard7_replica4, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429) at java.util.concurrent.FutureTask.get(FutureTask.java:191) at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:598) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:361) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) 20) Thread[id=18661, name=qtp639560314-18661, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 21) Thread[id=15920, name=searcherExecutor-3220-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 22) Thread[id=17454, name=qtp1764830233-17454, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 23) Thread[id=19277, name=coreZkRegister-3349-thread-57-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard5_replica1 s:shard5 c:awholynewstresscollection_collection2_4 r:core_node32, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 24) Thread[id=15963, name=searcherExecutor-3240-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 25) Thread[id=19547, name=searcherExecutor-4620-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 26) Thread[id=19688, name=qtp639560314-19688, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 27) Thread[id=15862, name=org.eclipse.jetty.server.session.HashSessionManager@49ef4326Timer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 28) Thread[id=19352, name=coreZkRegister-3349-thread-64, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 29) Thread[id=18132, name=coreZkRegister-3349-thread-24, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 30) Thread[id=18555, name=qtp699233344-18555, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 31) Thread[id=19125, name=zkCallback-873-thread-15-processing-n:127.0.0.1:48979__wgo-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 32) Thread[id=19696, name=zkCallback-873-thread-76-processing-n:127.0.0.1:48979__wgo, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 33) Thread[id=18128, name=coreZkRegister-3349-thread-20-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 34) Thread[id=18275, name=zkCallback-909-thread-25-processing-n:127.0.0.1:44719__wgo, state=BLOCKED, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 35) Thread[id=15861, name=Scheduler-393793085, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 36) Thread[id=18278, name=zkCallback-876-thread-32, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 37) Thread[id=17470, name=qtp639560314-17470, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController.register(ZkController.java:839) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:187) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:216) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:629) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:683) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:649) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:628) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:213) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:193) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:654) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:433) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 38) Thread[id=19119, name=zkCallback-873-thread-15-processing-n:127.0.0.1:48979__wgo-SendThread(127.0.0.1:44215), state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) 39) Thread[id=19210, name=coreZkRegister-3197-thread-59-processing-n:127.0.0.1:33469__wgo x:awholynewstresscollection_collection2_4_shard7_replica2 s:shard7 c:awholynewstresscollection_collection2_4 r:core_node12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 40) Thread[id=18232, name=coreZkRegister-3175-thread-9, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 41) Thread[id=17551, name=qtp639560314-17551, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 42) Thread[id=19173, name=coreZkRegister-3186-thread-51, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 43) Thread[id=19244, name=coreZkRegister-3186-thread-52-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ShardLeaderElectionContext.waitForReplicasToComeUp(ElectionContext.java:460) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:224) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 44) Thread[id=19535, name=searcherExecutor-4605-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 45) Thread[id=16089, name=org.eclipse.jetty.server.session.HashSessionManager@48dd0c49Timer, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 46) Thread[id=19576, name=searcherExecutor-4640-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 47) Thread[id=19692, name=zkCallback-873-thread-73, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 48) Thread[id=19477, name=RecoveryThread-awholynewcollection_0_shard2_replica1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:511) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) 49) Thread[id=19172, name=coreZkRegister-3186-thread-50, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 50) Thread[id=16267, name=searcherExecutor-3414-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 51) Thread[id=17110, name=qtp639560314-17110, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 52) Thread[id=18389, name=coreZkRegister-3349-thread-32-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:683) at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:652) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:980) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 53) Thread[id=19166, name=coreZkRegister-3186-thread-47-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=BLOCKED, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:299) at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:478) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:330) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 54) Thread[id=19691, name=zkCallback-870-thread-64, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.common.cloud.ZkStateReader$7.process(ZkStateReader.java:938) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 55) Thread[id=19391, name=searcherExecutor-4532-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 56) Thread[id=18387, name=coreZkRegister-3349-thread-30-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=BLOCKED, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:299) at org.apache.solr.cloud.ZkController.checkRecovery(ZkController.java:1095) at org.apache.solr.cloud.ZkController.register(ZkController.java:929) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 57) Thread[id=18199, name=coreZkRegister-3186-thread-20, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 58) Thread[id=15919, name=searcherExecutor-3219-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 59) Thread[id=15983, name=searcherExecutor-3282-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 60) Thread[id=18167, name=coreZkRegister-3197-thread-23, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 61) Thread[id=17206, name=searcherExecutor-4167-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 62) Thread[id=18361, name=coreZkRegister-3186-thread-27-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ActionThrottle.minimumWaitBetweenActions(ActionThrottle.java:82) at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:326) at org.apache.solr.cloud.ZkController.checkRecovery(ZkController.java:1095) at org.apache.solr.cloud.ZkController.register(ZkController.java:929) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 63) Thread[id=17499, name=qtp215754624-17499, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController.register(ZkController.java:839) at org.apache.solr.core.ZkContainer$2.run(ZkContainer.java:187) at org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:216) at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:629) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:683) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:649) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:628) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:213) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:193) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:654) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:433) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83) at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97) at org.eclipse.jetty.server.Server.handle(Server.java:499) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257) at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 64) Thread[id=19736, name=zkCallback-870-thread-67, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.common.cloud.ZkStateReader$7.process(ZkStateReader.java:938) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 65) Thread[id=18116, name=coreZkRegister-3349-thread-11-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 66) Thread[id=18239, name=coreZkRegister-3175-thread-15-processing-n:127.0.0.1:43783__wgo x:awholynewstresscollection_collection2_4_shard2_replica1 s:shard2 c:awholynewstresscollection_collection2_4 r:core_node9, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:683) at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:652) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:980) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 67) Thread[id=19733, name=RecoveryThread-awholynewstresscollection_collection0_4_shard1_replica3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429) at java.util.concurrent.FutureTask.get(FutureTask.java:191) at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:598) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:361) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227) 68) Thread[id=19567, name=searcherExecutor-4663-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 69) Thread[id=19243, name=zkCallback-876-thread-77, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 70) Thread[id=18334, name=coreZkRegister-3197-thread-39-processing-n:127.0.0.1:33469__wgo x:awholynewstresscollection_collection2_4_shard7_replica2 s:shard7 c:awholynewstresscollection_collection2_4 r:core_node12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 71) Thread[id=16081, name=qtp639560314-16081-selector-ServerConnectorManager@759ecdc5/1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.select(SelectorManager.java:600) at org.eclipse.jetty.io.SelectorManager$ManagedSelector.run(SelectorManager.java:549) at org.eclipse.jetty.util.thread.NonBlockingThread.run(NonBlockingThread.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) at java.lang.Thread.run(Thread.java:745) 72) Thread[id=19164, name=coreZkRegister-3186-thread-45-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34) at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:136) at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:315) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:199) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:348) at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:1070) at org.apache.solr.cloud.ZkController.register(ZkController.java:884) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 73) Thread[id=19293, name=coreZkRegister-3175-thread-26, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 74) Thread[id=19205, name=coreZkRegister-3197-thread-54, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 75) Thread[id=19162, name=coreZkRegister-3186-thread-43, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 76) Thread[id=18184, name=coreZkRegister-3186-thread-6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 77) Thread[id=17469, name=qtp215754624-17469, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 78) Thread[id=17490, name=qtp699233344-17490, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 79) Thread[id=19208, name=coreZkRegister-3197-thread-57, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 80) Thread[id=18229, name=coreZkRegister-3175-thread-6-processing-n:127.0.0.1:43783__wgo x:awholynewstresscollection_collection2_4_shard2_replica1 s:shard2 c:awholynewstresscollection_collection2_4 r:core_node9, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:683) at org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:652) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:959) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 81) Thread[id=19633, name=OverseerCollectionProcessor-94018458300252292-127.0.0.1:33469__wgo-n_0000000016, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320) at org.apache.solr.cloud.DistributedQueue.peekTopN(DistributedQueue.java:447) at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:317) at java.lang.Thread.run(Thread.java:745) 82) Thread[id=18526, name=qtp699233344-18526, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:389) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:531) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$700(QueuedThreadPool.java:47) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:590) at java.lang.Thread.run(Thread.java:745) 83) Thread[id=19735, name=zkCallback-870-thread-66, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at org.apache.solr.common.cloud.ZkStateReader$7.process(ZkStateReader.java:938) at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 84) Thread[id=18119, name=coreZkRegister-3349-thread-14-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 85) Thread[id=19171, name=coreZkRegister-3186-thread-49, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 86) Thread[id=18390, name=coreZkRegister-3349-thread-33-processing-n:127.0.0.1:44719__wgo x:awholynewstresscollection_collection2_4_shard8_replica4 s:shard8 c:awholynewstresscollection_collection2_4 r:core_node13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:955) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 87) Thread[id=19214, name=coreZkRegister-3197-thread-63, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 88) Thread[id=16104, name=Thread-11296, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1095) 89) Thread[id=19247, name=coreZkRegister-3186-thread-54-processing-n:127.0.0.1:48979__wgo x:awholynewstresscollection_collection2_4_shard3_replica1 s:shard3 c:awholynewstresscollection_collection2_4 r:core_node6, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ActionThrottle.minimumWaitBetweenActions(ActionThrottle.java:82) at org.apache.solr.update.DefaultSolrCoreState.doRecovery(DefaultSolrCoreState.java:326) at org.apache.solr.cloud.ZkController.checkRecovery(ZkController.java:1095) at org.apache.solr.cloud.ZkController.register(ZkController.java:929) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 90) Thread[id=17682, name=searcherExecutor-4390-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 91) Thread[id=18122, name=coreZkRegister-3197-thread-12-processing-n:127.0.0.1:33469__wgo x:awholynewstresscollection_collection2_4_shard7_replica2 s:shard7 c:awholynewstresscollection_collection2_4 r:core_node12, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1029) at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:999) at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:982) at org.apache.solr.cloud.ZkController.register(ZkController.java:896) at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 92) Thread[id=19435, name=searcherExecutor-4558-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 93) Thread[id=19695, name=zkCallback-873-thread-75, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 94) Thread[id=17720, name=searcherExecutor-4421-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Thread
[...truncated too long message...]
.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 240) Thread[id=18163, name=coreZkRegister-3197-thread-21, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 241) Thread[id=18192, name=coreZkRegister-3186-thread-13, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 242) Thread[id=16139, name=Scheduler-1744411394, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 243) Thread[id=19584, name=searcherExecutor-4664-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 244) Thread[id=19449, name=searcherExecutor-4566-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 245) Thread[id=17715, name=searcherExecutor-4420-thread-1, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 246) Thread[id=15907, name=Scheduler-23691200, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 247) Thread[id=19635, name=zkCallback-870-thread-63, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([5E4A046F50D6BFE0]:0)
[junit4] Completed [263/512] on J1 in 1186.58s, 1 test, 3 errors <<< FAILURES!
[...truncated 762 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 512 suites, 2014 tests, 2 suite-level errors, 2 errors, 888 ignored (9 assumptions)
Total time: 168 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 714 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/714/
3 tests failed.
REGRESSION: org.apache.solr.TestDistributedSearch.test
Error Message:
Captured an uncaught exception in thread: Thread[id=166959, name=Thread-161371, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=166959, name=Thread-161371, state=RUNNABLE, group=TGRP-TestDistributedSearch]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:54645//collection1: java.lang.NullPointerException
at org.apache.solr.search.grouping.distributed.responseprocessor.StoredFieldsShardResponseProcessor.process(StoredFieldsShardResponseProcessor.java:42)
at org.apache.solr.handler.component.QueryComponent.handleGroupedResponses(QueryComponent.java:744)
at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:727)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:388)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2057)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:648)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:452)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:499)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([A67B788F5276F3EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.TestDistributedSearch$1.run(TestDistributedSearch.java:1110)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=3934, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3934, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:47394/gxnp: collection already exists: awholynewstresscollection_collection5_0
at __randomizedtesting.SeedInfo.seed([A67B788F5276F3EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1570)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1591)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=29485, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=29485, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:36343/jkwc/id: Could not find collection : awholynewstresscollection_collection1_0
at __randomizedtesting.SeedInfo.seed([A67B788F5276F3EF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10302 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/init-core-data-001
[junit4] 2> 374176 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A67B788F5276F3EF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
[junit4] 2> 374177 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[A67B788F5276F3EF]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /gxnp/
[junit4] 2> 374186 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 374189 INFO (Thread-1369) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 374189 INFO (Thread-1369) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 374289 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkTestServer start zk server on port:54627
[junit4] 2> 374289 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374305 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374326 INFO (zkCallback-509-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a0a95da name:ZooKeeperConnection Watcher:127.0.0.1:54627 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374326 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 374332 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374338 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374350 INFO (zkCallback-510-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d7b84ba name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374351 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 374353 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 374358 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 374360 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 374362 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 374362 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 374364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 374364 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 374367 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 374368 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 374369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 374369 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 374371 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 374371 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 374373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 374373 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 374375 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 374375 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 374381 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 374381 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 374383 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 374383 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 374385 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 374386 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 374388 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 374388 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 374391 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374394 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374395 INFO (zkCallback-511-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a4273cb name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374395 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374395 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374715 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1
[junit4] 2> 374718 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 374724 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@68ad8b78{/gxnp,null,AVAILABLE}
[junit4] 2> 374734 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.ServerConnector Started ServerConnector@6e82d2f8{SSL-http/1.1}{127.0.0.1:59974}
[junit4] 2> 374735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server Started @378492ms
[junit4] 2> 374735 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/tempDir-001/control/data, hostContext=/gxnp, hostPort=59974, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores}
[junit4] 2> 374738 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 374739 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/'
[junit4] 2> 374762 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/solr.xml
[junit4] 2> 374770 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores
[junit4] 2> 374770 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer New CoreContainer 78553720
[junit4] 2> 374771 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/]
[junit4] 2> 374771 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/lib
[junit4] 2> 374771 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/lib).
[junit4] 2> 374780 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 374787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 374790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 374790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 374790 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54627/solr
[junit4] 2> 374791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 374791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 374794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374795 INFO (zkCallback-513-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5be85332 name:ZooKeeperConnection Watcher:127.0.0.1:54627 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374795 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374795 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 374802 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 374838 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@28c8a332 name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 374839 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 374840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 374841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 374843 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 374844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 374845 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 374847 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 374848 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 374849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 374849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59974_gxnp
[junit4] 2> 374850 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:59974_gxnp
[junit4] 2> 374851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 374852 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 374853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 374853 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94012701380378628-127.0.0.1:59974_gxnp-n_0000000000
[junit4] 2> 374854 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59974_gxnp
[junit4] 2> 374854 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 374855 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer Overseer (id=94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) starting
[junit4] 2> 374856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 374870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 374873 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 374886 INFO (OverseerCollectionProcessor-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 374901 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 374903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 374903 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 374904 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores
[junit4] 2> 374905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 374905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/
[junit4] 2> 374905 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 374911 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 374911 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 374913 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 374917 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 374917 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 374918 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 374918 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 374918 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 374919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 374919 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:59974_gxnp ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 374920 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 374921 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 375913 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 375913 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 375914 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 375914 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 375915 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 375915 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/'
[junit4] 2> 375928 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 375934 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 375937 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 375958 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 375959 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 375965 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 376057 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 376063 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 376065 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 376074 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 376077 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 376079 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 376079 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 376080 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 376080 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 376080 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 376080 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 376080 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 376081 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 376081 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 376081 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@17bd97d4
[junit4] 2> 376082 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data
[junit4] 2> 376082 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/index/
[junit4] 2> 376082 WARN (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 376083 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/index
[junit4] 2> 376083 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=33.0634765625, floorSegmentMB=1.396484375, forceMergeDeletesPctAllowed=24.399196593063046, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2049409071727861
[junit4] 2> 376084 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20ce86c4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d83e640),segFN=segments_1,generation=1}
[junit4] 2> 376084 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 376085 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/
[junit4] 2> 376088 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 376089 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 376090 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 376092 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376093 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376094 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376095 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 376098 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 376099 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 376099 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 376099 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 376100 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 376100 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 376101 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=97.3349609375, floorSegmentMB=0.39453125, forceMergeDeletesPctAllowed=11.768434559546574, segmentsPerTier=13.0, maxCFSSegmentSizeMB=1.4609375, noCFSRatio=0.2478076390394219
[junit4] 2> 376101 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@20ce86c4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d83e640),segFN=segments_1,generation=1}
[junit4] 2> 376101 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 376102 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1172d511[collection1] main
[junit4] 2> 376102 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 376103 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 376104 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 376105 INFO (searcherExecutor-1287-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1172d511[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 376105 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504203224093032448
[junit4] 2> 376108 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1504203224093032448
[junit4] 2> 376108 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 376108 INFO (coreLoadExecutor-1286-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 376109 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:59974/gxnp collection:control_collection shard:shard1
[junit4] 2> 376110 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 376113 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94012701380378628-core_node1-n_0000000000
[junit4] 2> 376113 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 376118 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:59974/gxnp/collection1/
[junit4] 2> 376119 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 376119 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:59974/gxnp/collection1/ has no replicas
[junit4] 2> 376120 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:59974/gxnp/collection1/ shard1
[junit4] 2> 376120 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 376123 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 376124 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 376226 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 376227 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:59974/gxnp/collection1/ and leader is https://127.0.0.1:59974/gxnp/collection1/
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:59974/gxnp
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 376276 INFO (coreZkRegister-1280-thread-1-processing-n:127.0.0.1:59974_gxnp x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:59974_gxnp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 376277 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 376278 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 376279 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:59974/gxnp",
[junit4] 2> "node_name":"127.0.0.1:59974_gxnp",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 376384 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 376386 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 376422 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 376423 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 376424 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3fda7395 name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 376424 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 376425 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 376425 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 376427 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 376785 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1
[junit4] 2> 376787 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001
[junit4] 2> 376788 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 376791 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@977cf82{/gxnp,null,AVAILABLE}
[junit4] 2> 376794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.ServerConnector Started ServerConnector@50872e97{SSL-http/1.1}{127.0.0.1:45991}
[junit4] 2> 376794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.e.j.s.Server Started @380552ms
[junit4] 2> 376794 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/gxnp, hostPort=45991, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores}
[junit4] 2> 376796 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 376796 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/'
[junit4] 2> 376810 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/solr.xml
[junit4] 2> 376814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores
[junit4] 2> 376814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer New CoreContainer 1666041875
[junit4] 2> 376815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/]
[junit4] 2> 376815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/lib
[junit4] 2> 376815 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/lib).
[junit4] 2> 376821 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 376823 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54627/solr
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 376825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 376826 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 376827 INFO (zkCallback-518-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7708d399 name:ZooKeeperConnection Watcher:127.0.0.1:54627 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 376827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 376828 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 376829 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 376830 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f521ed9 name:ZooKeeperConnection Watcher:127.0.0.1:54627/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 376830 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 376834 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 377837 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45991_gxnp
[junit4] 2> 377838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:45991_gxnp
[junit4] 2> 377840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 377841 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94012701380378631-127.0.0.1:45991_gxnp-n_0000000001
[junit4] 2> 377842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94012701380378628-127.0.0.1:59974_gxnp-n_0000000000 to know if I could be the leader
[junit4] 2> 377842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 377842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 377843 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores
[junit4] 2> 377844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 377844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1/
[junit4] 2> 377844 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 377845 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 377845 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 377845 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 377846 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 377846 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45991/gxnp",
[junit4] 2> "node_name":"127.0.0.1:45991_gxnp",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 377847 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:45991/gxnp",
[junit4] 2> "node_name":"127.0.0.1:45991_gxnp",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 377847 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 377847 INFO (OverseerStateUpdate-94012701380378628-127.0.0.1:59974_gxnp-n_0000000000) [n:127.0.0.1:59974_gxnp ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 377851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 377851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[A67B788F5276F3EF]) [n:127.0.0.1:45991_gxnp ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 377949 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 377949 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 377949 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 377951 INFO (zkCallback-516-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 377951 INFO (zkCallback-514-thread-1-processing-n:127.0.0.1:59974_gxnp) [n:127.0.0.1:59974_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 377951 INFO (zkCallback-519-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 378846 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 378847 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 378848 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_A67B788F5276F3EF-001/shard-1-001/cores/collection1/'
[junit4] 2> 378863 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 378867 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 378871 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 378880 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 378881 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 378886 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 378984 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 378990 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 378991 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 378999 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 379002 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 379004 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 379005 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 379005 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 379005 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 379006 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 379006 WARN (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 379006 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 379006 INFO (coreLoadExecutor-1297-thread-1-processing-n:127.0.0.1:45991_gxnp) [n:127.0.0.1:45991_gxnp c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirec
[...truncated too long message...]
it4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
[junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
[junit4] 2> at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:483)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4290292 INFO (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[A67B788F5276F3EF]-worker) [n:127.0.0.1:36343_jkwc%2Fid c:addReplicaColl s:shard2 r:core_node2 x:addReplicaColl_shard2_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jun 17, 2015 2:51:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene53, sim=DefaultSimilarity, locale=hu, timezone=Australia/Queensland
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=2,free=205835792,total=522715136
[junit4] 2> NOTE: All tests run in this JVM: [ShardRoutingCustomTest, TestAnalyzeInfixSuggestions, TestManagedSchemaDynamicFieldResource, BlockDirectoryTest, TestSolrCoreProperties, IndexSchemaRuntimeFieldTest, ReplicationFactorTest, TestSchemaNameResource, ChaosMonkeySafeLeaderTest, DistributedQueryComponentOptimizationTest, TestStressVersions, TestDownShardTolerantSearch, TestAuthenticationFramework, TestTolerantSearch, BadCopyFieldTest, DistributedMLTComponentTest, DeleteLastCustomShardedReplicaTest, TestJettySolrRunner, CollectionsAPIAsyncDistributedZkTest, DocumentBuilderTest, TestCryptoKeys, SpellingQueryConverterTest, RuleEngineTest, TestCharFilters, NoCacheHeaderTest, TestBulkSchemaConcurrent, TestCollationFieldDocValues, ZkCLITest, TestExpandComponent, SolrPluginUtilsTest, HighlighterMaxOffsetTest, AddBlockUpdateTest, ReturnFieldsTest, HdfsThreadLeakTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestOmitPositions, TestOverriddenPrefixQueryForCustomFieldType, CollectionsAPIDistributedZkTest, ShardSplitTest, SaslZkACLProviderTest, TestComponentsName, TestCoreContainer, TestFastLRUCache, TestDynamicLoading, SpatialHeatmapFacetsTest, OverseerStatusTest, TestCoreDiscovery, SolrXmlInZkTest, TestCloudSchemaless, TestManagedResourceStorage, TestComplexPhraseQParserPlugin, JavabinLoaderTest, TestStressUserVersions, DocValuesMultiTest, HttpPartitionTest, ResourceLoaderTest, SpellCheckComponentTest, StatelessScriptUpdateProcessorFactoryTest, SolrCloudExampleTest, DistributedQueryComponentCustomSortTest, TestBulkSchemaAPI, TestBlobHandler, TestLRUCache, AlternateDirectoryTest, HdfsBasicDistributedZk2Test, TestSolrConfigHandlerCloud, TestSuggestSpellingConverter, TestRemoveLastDynamicCopyField, TestJsonRequest, DistributedExpandComponentTest, DistanceFunctionTest, ZkSolrClientTest, TestSolrConfigHandlerConcurrent, BadComponentTest, MigrateRouteKeyTest, TestHashPartitioner, ClusterStateUpdateTest, TestManagedSchemaFieldTypeResource, TestSearchPerf, PreAnalyzedFieldTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestRandomFaceting, TestZkChroot, TestDistributedGrouping, TestReload, SimpleFacetsTest, TestGroupingSearch, ConvertedLegacyTest, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestIndexSearcher, SoftAutoCommitTest, SolrRequestParserTest, DocValuesTest, TestTrie, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, TestRemoteStreaming, CacheHeaderTest, LukeRequestHandlerTest, TestWriterPerf, PrimitiveFieldTypeTest, XmlUpdateRequestHandlerTest, RequiredFieldsTest, TestArbitraryIndexDir, IndexSchemaTest, JSONWriterTest, TestAnalyzedSuggestions, TestPHPSerializedResponseWriter, TestBinaryResponseWriter, SOLR749Test, UpdateParamsTest, CopyFieldTest, ResponseLogComponentTest, SolrIndexConfigTest, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestDocSet, MinimalSchemaTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, PrimUtilsTest, DateFieldTest, RAMDirectoryFactoryTest, ClusterStateTest, TestUtils, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, TestRTGBase, DistributedIntervalFacetingTest, CloudExitableDirectoryReaderTest, CustomCollectionTest, LeaderFailoverAfterPartitionTest, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestRebalanceLeaders, VMParamsZkACLAndCredentialsProvidersTest, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest]
[junit4] Completed [511/511] on J1 in 953.58s, 1 test, 1 error <<< FAILURES!
[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 511 suites, 2012 tests, 3 errors, 20 ignored (10 assumptions)
Total time: 180 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 713 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/713/
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]
Stack Trace:
java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [TransactionLog]
at __randomizedtesting.SeedInfo.seed([547BEA79E2A6115B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:235)
at sun.reflect.GeneratedMethodAccessor42.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest.test
Error Message:
shard1 is not consistent. Got 168 from http://127.0.0.1:51292/collection1lastClient and got 150 from http://127.0.0.1:47576/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 168 from http://127.0.0.1:51292/collection1lastClient and got 150 from http://127.0.0.1:47576/collection1
at __randomizedtesting.SeedInfo.seed([547BEA79E2A6115B:DC2FD5A34C5A7CA3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1242)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1221)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test(ChaosMonkeySafeLeaderTest.java:165)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:39630: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39630: Error CREATEing SolrCore 'halfcollection_shard1_replica1': Unable to create core [halfcollection_shard1_replica1] Caused by: Could not get shard id for core: halfcollection_shard1_replica1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:309)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:437)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:176)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=5546, name=collection2, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5546, name=collection2, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:41432/tf/h: Could not find collection : awholynewstresscollection_collection2_0
at __randomizedtesting.SeedInfo.seed([547BEA79E2A6115B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:902)
Build Log:
[...truncated 10610 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/init-core-data-001
[junit4] 2> 2055073 INFO (SUITE-HttpPartitionTest-seed#[547BEA79E2A6115B]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 2055080 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2055080 INFO (Thread-5334) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2055080 INFO (Thread-5334) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2055180 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkTestServer start zk server on port:36393
[junit4] 2> 2055180 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2055186 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055195 INFO (zkCallback-1806-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@36b9343d name:ZooKeeperConnection Watcher:127.0.0.1:36393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055195 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055196 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2055196 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 2055204 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2055209 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055209 INFO (zkCallback-1807-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c11ead6 name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055210 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055210 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2055210 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 2055216 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 2055218 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 2055222 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 2055229 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2055229 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2055233 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2055234 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 2055237 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2055237 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2055241 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2055242 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2055247 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2055247 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 2055250 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2055250 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 2055251 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2055252 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2055253 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2055253 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2055254 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2055254 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2055256 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2055256 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2055257 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2055257 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2055809 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1
[junit4] 2> 2055813 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 2055820 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ba6e5e7{/,null,AVAILABLE}
[junit4] 2> 2055821 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@313eaa6{HTTP/1.1}{127.0.0.1:53699}
[junit4] 2> 2055821 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server Started @2058941ms
[junit4] 2> 2055821 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/tempDir-001/control/data, hostContext=/, hostPort=52375, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores}
[junit4] 2> 2055822 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 2055822 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/'
[junit4] 2> 2055872 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/solr.xml
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer New CoreContainer 790998541
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/]
[junit4] 2> 2055878 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/lib
[junit4] 2> 2055879 WARN (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/lib).
[junit4] 2> 2055890 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2055892 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2055893 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2055894 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2055897 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36393/solr
[junit4] 2> 2055897 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2055897 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2055898 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055911 INFO (zkCallback-1809-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d2eac0b name:ZooKeeperConnection Watcher:127.0.0.1:36393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055911 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055912 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2055913 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x14dfc4ca8530002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2055914 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2055915 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b4b133b name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2055915 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2055917 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 2055919 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 2055923 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 2055928 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 2055931 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 2055933 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 2055940 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 2055943 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 2055944 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52375_
[junit4] 2> 2055945 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52375_
[junit4] 2> 2055951 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 2055954 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 2055955 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2055956 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94008573416374275-127.0.0.1:52375_-n_0000000000
[junit4] 2> 2055957 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52375_
[junit4] 2> 2055957 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 2055960 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer Overseer (id=94008573416374275-127.0.0.1:52375_-n_0000000000) starting
[junit4] 2> 2055966 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 2055978 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2055979 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2055979 INFO (OverseerCollectionProcessor-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
[junit4] 2> 2055980 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2055990 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2055991 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2055991 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores
[junit4] 2> 2055992 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2055992 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/
[junit4] 2> 2055992 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2055995 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2055996 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2055996 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2055996 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:52375_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2055996 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2055999 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2056000 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2056001 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 2056001 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 2056005 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2056011 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
[junit4] 2> 2056015 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2056996 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2056997 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 2056997 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2056997 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2056998 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2056999 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/'
[junit4] 2> 2057022 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2057046 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2057049 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2057059 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2057060 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2057069 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2057188 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2057195 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2057196 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2057210 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2057212 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2057216 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2057217 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2057218 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2057219 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2057220 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2057221 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 2057221 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e9e4449
[junit4] 2> 2057222 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data
[junit4] 2> 2057222 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/index/
[junit4] 2> 2057222 WARN (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2057223 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/index
[junit4] 2> 2057223 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=714039037, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2057223 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@56242e20 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e161143),segFN=segments_1,generation=1}
[junit4] 2> 2057224 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2057225 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/
[junit4] 2> 2057225 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 2057230 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 2057231 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 2057231 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 2057232 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2057233 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 2057233 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2057237 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057238 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057239 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057241 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 2057246 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
[junit4] 2> 2057246 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2057247 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2057247 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2057249 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
[junit4] 2> 2057249 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
[junit4] 2> 2057249 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=27.9072265625, floorSegmentMB=2.193359375, forceMergeDeletesPctAllowed=1.6415820687032423, segmentsPerTier=36.0, maxCFSSegmentSizeMB=2.1064453125, noCFSRatio=0.6217567923197758
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@56242e20 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1e161143),segFN=segments_1,generation=1}
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@36169850[collection1] main
[junit4] 2> 2057250 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
[junit4] 2> 2057252 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2057252 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2057252 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2057253 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 2057254 INFO (searcherExecutor-3434-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@36169850[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 2057254 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2057255 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1504137176933203968
[junit4] 2> 2057257 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3 ms to seed version buckets with highest version 1504137176933203968
[junit4] 2> 2057257 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 2057258 INFO (coreLoadExecutor-3433-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 2057259 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:52375 collection:control_collection shard:shard1
[junit4] 2> 2057260 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2057267 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94008573416374275-core_node1-n_0000000000
[junit4] 2> 2057270 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
[junit4] 2> 2057272 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2057272 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2057273 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:52375/collection1/
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:52375/collection1/ has no replicas
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:52375/collection1/ shard1
[junit4] 2> 2057273 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2057281 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2057282 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 2057385 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057387 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:52375/collection1/ and leader is http://127.0.0.1:52375/collection1/
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52375
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2057434 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 2057435 INFO (coreZkRegister-3427-thread-1-processing-n:127.0.0.1:52375_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:52375_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2057436 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2057437 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 2057438 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:52375",
[junit4] 2> "node_name":"127.0.0.1:52375_",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 2057502 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2057506 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2057507 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e31aa25 name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2057507 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2057507 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2057508 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2057514 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2057541 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057543 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2057543 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 2057545 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
[junit4] 2> 2058031 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1
[junit4] 2> 2058032 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001
[junit4] 2> 2058033 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server jetty-9.2.11.v20150529
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d8a0af4{/,null,AVAILABLE}
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.ServerConnector Started ServerConnector@69d8feb2{HTTP/1.1}{127.0.0.1:45010}
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.e.j.s.Server Started @2061160ms
[junit4] 2> 2058040 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=54994, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores}
[junit4] 2> 2058041 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
[junit4] 2> 2058041 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/'
[junit4] 2> 2058063 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/solr.xml
[junit4] 2> 2058068 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores
[junit4] 2> 2058068 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer New CoreContainer 926539785
[junit4] 2> 2058069 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/]
[junit4] 2> 2058069 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/lib
[junit4] 2> 2058069 WARN (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/lib).
[junit4] 2> 2058095 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2058096 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36393/solr
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 2058097 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 2058098 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2058100 INFO (zkCallback-1814-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4751fc09 name:ZooKeeperConnection Watcher:127.0.0.1:36393 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2058101 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2058101 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 2058104 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 2058105 INFO (zkCallback-1815-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@78777c91 name:ZooKeeperConnection Watcher:127.0.0.1:36393/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2058105 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 2058114 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 2059119 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54994_
[junit4] 2> 2059119 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54994_
[junit4] 2> 2059126 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2059126 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94008573416374278-127.0.0.1:54994_-n_0000000001
[junit4] 2> 2059128 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94008573416374275-127.0.0.1:52375_-n_0000000000 to know if I could be the leader
[junit4] 2> 2059128 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 2059128 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 2059129 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores
[junit4] 2> 2059130 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 2059130 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1/
[junit4] 2> 2059130 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.c.CoresLocator Found 1 core definitions
[junit4] 2> 2059132 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 2059132 INFO (TEST-HttpPartitionTest.test-seed#[547BEA79E2A6115B]) [n:127.0.0.1:54994_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 2059134 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 2059134 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 2059135 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 2059136 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2059137 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54994",
[junit4] 2> "node_name":"127.0.0.1:54994_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 2059139 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:54994",
[junit4] 2> "node_name":"127.0.0.1:54994_",
[junit4] 2> "numShards":"2",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 2059139 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 2059139 INFO (OverseerStateUpdate-94008573416374275-127.0.0.1:52375_-n_0000000000) [n:127.0.0.1:52375_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
[junit4] 2> 2059140 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2059140 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2059140 INFO (zkCallback-1815-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2059141 INFO (zkCallback-1812-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 2059142 INFO (zkCallback-1815-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 2059143 INFO (zkCallback-1810-thread-1-processing-n:127.0.0.1:52375_) [n:127.0.0.1:52375_ ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
[junit4] 2> 2060135 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 2060136 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
[junit4] 2> 2060137 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 2060137 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
[junit4] 2> 2060137 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2060138 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest_547BEA79E2A6115B-001/shard-1-001/cores/collection1/'
[junit4] 2> 2060163 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 2060170 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 2060174 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
[junit4] 2> 2060186 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2060187 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2060193 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 2060321 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2060330 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 2060332 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 2060343 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2060346 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 2060350 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2060351 WARN (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
[junit4] 2> 2060352 WARN (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
[junit4] 2> 2060352 INFO (coreLoadExecutor-3444-thread-1-processing-n:127.0.0.1:54994_) [n:127.0.0.1:54994_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[juni
[...truncated too long message...]
le.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.lang.NullPointerException
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
[junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
[junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
[junit4] 2> ... 53 more
[junit4] 2> 4006585 INFO (SUITE-HdfsChaosMonkeySafeLeaderTest-seed#[547BEA79E2A6115B]-worker) [n:127.0.0.1:48730_ c:collection1 s:shard1 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeySafeLeaderTest_547BEA79E2A6115B-001
[junit4] 2> Jun 16, 2015 8:49:03 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=sq, timezone=Pacific/Wallis
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=3,free=255404328,total=516947968
[junit4] 2> NOTE: All tests run in this JVM: [TestHighlightDedupGrouping, TestDynamicFieldResource, TestSolrConfigHandler, TestRemoteStreaming, TestStandardQParsers, CSVRequestHandlerTest, TestDynamicFieldCollectionResource, TestBadConfig, TestIBSimilarityFactory, DeleteInactiveReplicaTest, LeaderElectionIntegrationTest, ClusterStateTest, RequestHandlersTest, HighlighterTest, TestDistributedMissingSort, TestWordDelimiterFilterFactory, TestDocBasedVersionConstraints, MergeStrategyTest, TestRestoreCore, HdfsDirectoryFactoryTest, SolrRequestParserTest, RemoteQueryErrorTest, SolrTestCaseJ4Test, TestRandomFaceting, TestRestManager, TestAddFieldRealTimeGet, TestCodecSupport, RulesTest, TestFieldResource, TestMacros, TestBinaryField, DistributedFacetPivotWhiteBoxTest, SpatialRPTFieldTypeTest, TestManagedSynonymFilterFactory, StandardRequestHandlerTest, BaseCdcrDistributedZkTest, TestHighFrequencyDictionaryFactory, TestSolr4Spatial, SegmentsInfoRequestHandlerTest, TestJmxIntegration, SolrIndexConfigTest, TestCloudManagedSchema, TestRealTimeGet, TestCloudInspectUtil, SyncSliceTest, SchemaVersionSpecificBehaviorTest, PingRequestHandlerTest, TestUpdate, TestFreeTextSuggestions, TermsComponentTest, BasicZkTest, TestInfoStreamLogging, TestCSVLoader, ExternalFileFieldSortTest, TestTrackingShardHandlerFactory, DistributedFacetPivotLongTailTest, TestBlendedInfixSuggestions, TestReRankQParserPlugin, TestCollapseQParserPlugin, ChaosMonkeyNothingIsSafeTest, HdfsRecoverLeaseTest, AliasIntegrationTest, SimpleCollectionCreateDeleteTest, LeaderFailoverAfterPartitionTest, SolrCoreTest, TestIndexingPerformance, ParsingFieldUpdateProcessorsTest, SignatureUpdateProcessorFactoryTest, HighlighterConfigTest, TimeZoneUtilsTest, MBeansHandlerTest, DateFieldTest, MultiTermTest, UUIDFieldTest, DistributedIntervalFacetingTest, ResponseHeaderTest, CdcrUpdateLogTest, DeleteShardTest, ExitableDirectoryReaderTest, TestRangeQuery, DistributedSpellCheckComponentTest, SuggesterWFSTTest, BasicDistributedZkTest, OverseerTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, ShardRoutingCustomTest, TestDistributedSearch, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestHashPartitioner, ZkControllerTest, TestJoin, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, SimpleFacetsTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, TestFunctionQuery, TestLazyCores, OverseerCollectionProcessorTest, SoftAutoCommitTest, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, SpellCheckCollatorTest, SuggesterFSTTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, SuggesterTSTTest, SuggesterTest, TestStressLucene, SpatialFilterTest, NoCacheHeaderTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, QueryEqualityTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestReversedWildcardFilterFactory, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TestValueSourceCache, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaTest, TestCollationField, UpdateRequestProcessorFactoryTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestComponentsName, SearchHandlerTest, TestQuerySenderListener, TestSolrIndexConfig, CopyFieldTest, TestStressRecovery, TestMergePolicyConfig, SampleTest, TestDocSet, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, ResourceLoaderTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, DateMathParserTest, PreAnalyzedFieldTest, SpellingQueryConverterTest, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, FileUtilsTest, CircularListTest, CursorPagingTest, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, AssignTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, ConnectionManagerTest, CustomCollectionTest, DeleteReplicaTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, DistribJoinFromCollectionTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnCommitTest, MultiThreadedOCPTest, RecoveryAfterSoftCommitTest, SharedFSAutoReplicaFailoverUtilsTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCloudPivotFacet, TestCollectionAPI, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestMiniSolrCloudCluster, HdfsChaosMonkeySafeLeaderTest]
[junit4] Completed [418/511] on J0 in 141.42s, 1 test, 1 failure <<< FAILURES!
[...truncated 309 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 511 suites, 2010 tests, 1 suite-level error, 2 errors, 1 failure, 20 ignored (10 assumptions)
Total time: 228 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure